Limitations of iterable datasets

🤗Datasets
12

Thanks for this recommendation! I thought since we use ShufflerIterDataPipe there is no need to set Shuffle=True in the DataLoader. I assumed the shuffle is done by ShufflerIterDataPipe, isn’t it?