Currently my custom data set gives None indices in the data loader, but NOT in the pure data set. When I wrap it in pytorch data loader it fails. Code is in colab but will put it here in case colab dies someday: pip install datasets pip install pytorch pip install transformers then run token = N…

How does one create a pytorch data loader with a custom hugging face data set without having errors?

brando August 10, 2023, 6:42pm 2

Topic		Replies	Views
How does one create a pytoch data loader using an interleaved hugging face dataset? Beginners	3	1068	August 18, 2023
Dataloader time problem on custom dataset based on huggingface Beginners	2	801	June 14, 2022
HuggingFace dataset: each element in list of batch should be of equal size 🤗Datasets	3	8630	August 10, 2023
Tensorflow Huggingface Datasets Equivalent to PyTorch 🤗Datasets	2	894	June 27, 2022
Pipeline with custom dataset tokenizer: when to save/load manually 🤗Datasets	18	4665	September 18, 2020