Issues with Pythia model finetuning

I cannot see your code but I got a similar error. I found the solution here:
you need to add a TrainingArguments to your Trainer, with remove_unused_columns=False (see the link for details)