Hey guys. I’m trying to fine-tune a GPT2 model using the DataCollatorForLanguageModelling, but I’m getting a message like:
I’m not asking to pad it anywhere, does anyone has a clue about what should be going wrong?
I’m not asking to pad it anywhere, does anyone has a clue about what should be going wrong?
Hi ! I think some users have already experienced this issue and found a fix in this thread:
https://github.com/huggingface/transformers/issues/3859
I hope that helps 