To rule out any issues I might be having caused by installed libraries, I tried this again with a preconfigured Paperspace Gradient notebook (setfit/notebooks at main · huggingface/setfit · GitHub).
I got the exact same error during training however