Wav2vec2.0 memory issue for basic inference

Models
2

The solution is mentioned in this thread: wave2vec OOM while doing inference · Issue #3359 · facebookresearch/fairseq · GitHub and it does fix the issue.

I will close this one then.