Unable to run PEFT training due to IndexError: Invalid key: 14177

Hello,

This is my first time fine tuning a model. My goal is to use PEFT on a dataset I curated for movie transcript output. This is for a personal project I am working on.

I am currently running this in a Collab notebook on a V100.The model is cognitivecomputations/dolphin-2_6-phi-2

I was able to resolve the error by adding remove_unused_columns=False to my training arguments.

1 Like