Running out of memory during dataset.map() with `AutoFeatureExtractor.from_pretrained("facebook/hubert-large-ls960-ft")`

@nateraw This is actually a duplicate question. See the solution to this question for the fix.

Spoiler: you have to pass cache_file_name in .map().

2 Likes