Hi, I am trying to fine tune MT5 for multitask question answer and question generation similar to @valhalla model. I prepared the dataset by using datasets library as follows: train_dataset = Dataset.from_pandas(pd.DataFrame(generate_data(mode="train"))) valid_dataset = Dataset.from_pandas…

yes I was using Trainer. But I solved the problem. I was loading dataset via Datasets library, when I replaced it with nlp.load_dataset, it worked seamlessly. But thank you for the response, I did not pass --remove_unused_columns False

MT5 Fine Tuning - KeyError: 'source_ids'

🤗Transformers

Sahajtomar May 7, 2021, 10:51am 5

Hi, I have custom data and I am not able to load dataset with nlp.load_dataset. With dataset library I am getting same error. Could you tell me how you resoolved it

Topic		Replies	Views
IndexError: Invalid key: 16 is out of bounds for size 0 🤗Datasets	26	23456	June 5, 2024
The following columns in the training set don't have a corresponding argument 🤗Transformers	2	8091	October 5, 2024
No key 'messages' found 🤗Transformers	2	55	February 15, 2025
Transformers: Fine-tuning is failed on dataset built from csv file Beginners	0	893	July 22, 2021
Chapter 3 questions Course	147	10430	August 18, 2025

MT5 Fine Tuning - KeyError: 'source_ids'

Related topics