Unable to run PEFT training due to IndexError: Invalid key: 14177

Beginners
1

Hello,

This is my first time fine tuning a model. My goal is to use PEFT on a dataset I curated for movie transcript output. This is for a personal project I am working on.

image
image1152×748 38.9 KB

I am currently running this in a Collab notebook on a V100.The model is cognitivecomputations/dolphin-2_6-phi-2

2

I was able to resolve the error by adding remove_unused_columns=False to my training arguments.

2 Likes