Hugging Face Forums
Creating a HF Dataset from lakeFS with S3 storage takes too much time!
🤗Datasets
John6666
June 20, 2025, 11:14am
5
imagefolder
is mainly for small image datasets, so I don’t think it’s very fast.
2 Likes
show post in topic
Related topics
Topic
Replies
Views
Activity
Extremely slow data loading of imagefolder
🤗Datasets
9
2437
January 4, 2024
Handling large image datasets
🤗Datasets
7
1928
June 30, 2022
5M small images (~100Gb)
🤗Datasets
2
517
July 5, 2022
Loading Huge Image Dataset seems to take a lot of time
🤗Datasets
7
3743
May 16, 2022
Allow streaming of large datasets with image/audio
🤗Datasets
18
3954
May 30, 2022