Hi! My question is not directly related to HF libraries, so it is a bit off-topic, but I hope the moderators will not take too strict a view on that and let me keep it. When training ResNet on ImageNet dataset, I coded some dataloading functionality by hand, which was extremely useful to me. I am …

PyTorch Dataset/DataLoader classes

alexgrishin November 25, 2021, 8:45pm 4

Yes! Thank you!

Topic		Replies	Views
Loading a large parquet dataset with varying image resolutions 🤗Datasets	2	266	October 24, 2024
Asynchronous Data Pre-Processing for Multi Modal Models 🤗Transformers	5	566	October 4, 2024
Trainer + Datasets + Pytorch Dataloader Workers - how to manage memory usage? 🤗Transformers	1	47	April 29, 2025
Uploading a heavy dataset to Jean-Zay Intermediate	3	78	February 17, 2025
Best practice loading images files 🤗Datasets	3	1626	March 27, 2024