I have been following the instruction from the huggingface course which was told that rather than using padding for all dataset, its better just use datacollator with padding in each batch. So, i made it, my task is to fine-tune t5 model using my own dataset, but it has error when i tried to inspect…

Can't iterate a DataLoader

joanitolopo February 25, 2022, 1:05am 2

this is the error

Topic		Replies	Views
Can't iterate through the data loader object after dynamic padding Beginners	1	858	July 8, 2022
Issues with Data Collator and Tokenizing with NER Datasets 🤗Tokenizers	1	2569	May 9, 2022
How to deal with DataCollator and DataLoaders in Huggingface? DeepSpeed	0	1169	February 2, 2023
Cannot get DataCollator to prepare tf dataset 🤗Transformers	0	488	July 15, 2022
ValueError in using DataCollator: Unable to create tensor, you should probably activate truncation and/or padding with 'padding=True' 'truncation=True' to have batched tensors with the same length 🤗Transformers	1	7704	January 26, 2023