Memory error while loading custom dataset

🤗Datasets
6

Hi ! You can set DEFAULT_WRITER_BATCH_SIZE = 10 as a class attribute to MusdbDataset - this way it will use 10 by default for your dataset.

It’s also possible to pass writer_batch_size to load_dataset()