Currently my custom data set gives None indices in the data loader, but NOT in the pure data set. When I wrap it in pytorch data loader it fails. Code is in colab but will put it here in case colab dies someday: pip install datasets pip install pytorch pip install transformers then run token = N…

How does one create a pytorch data loader with a custom hugging face data set without having errors?

brando August 10, 2023, 7:23pm 3

Topic		Replies	Views
How does one create a pytoch data loader using an interleaved hugging face dataset? Beginners	3	1030	August 18, 2023
Dataloader time problem on custom dataset based on huggingface Beginners	2	784	June 14, 2022
HuggingFace dataset: each element in list of batch should be of equal size 🤗Datasets	3	8497	August 10, 2023
Tensorflow Huggingface Datasets Equivalent to PyTorch 🤗Datasets	2	881	June 27, 2022
Pipeline with custom dataset tokenizer: when to save/load manually 🤗Datasets	18	4592	September 18, 2020