Currently my custom data set gives None indices in the data loader, but NOT in the pure data set. When I wrap it in pytorch data loader it fails. Code is in colab but will put it here in case colab dies someday: pip install datasets pip install pytorch pip install transformers then run token = N…

How does one create a pytorch data loader with a custom hugging face data set without having errors?

brando August 14, 2023, 10:26pm 4

Topic		Replies	Views
How does one create a pytoch data loader using an interleaved hugging face dataset? Beginners	3	1572	August 18, 2023
How to use huggingface HF trainer train with custom collate function? Beginners	10	4267	August 21, 2023
Using Hugging Face dataset class as pytorch class Beginners	3	585	September 29, 2021
Dataloader time problem on custom dataset based on huggingface Beginners	2	1013	June 14, 2022
HuggingFace dataset: each element in list of batch should be of equal size 🤗Datasets	3	10301	August 10, 2023