Hugging Face Forums
How to handle big data?
🤗Datasets
lhoestq
May 25, 2023, 3:08pm
7
it can be related to
IndexError: Invalid key: 16 is out of bounds for size 0 - #3 by Isma
show post in topic
Related topics
Topic
Replies
Views
Activity
Support of very large dataset?
🤗Datasets
12
10290
August 24, 2022
Big text dataset loading for training
🤗Datasets
2
42
May 7, 2025
Working with large datasets
🤗Datasets
5
4101
November 10, 2020
Loading a dataset doesn't actually memory map
🤗Datasets
1
921
September 4, 2023
`load_dataset` results in OOM
🤗Datasets
0
169
June 25, 2024