Can't run quenstion-answer LLM finetuning demo in google colab

Beginners
1

I am trying to get familiar with the fine-tuning example from the link below. I clicked open in colab with pytorch.

However, when executing the training argument line, I received the ImportError as below. I tried pip install

image
image1351×544 26.9 KB

I didn’t do any additional coding.

Please let me know if you have any idea to solve this issue. Thank you very much.

2

This is a problem I faced while doing many other demo notebooks as well.
So the solution I found is to run this at the very start of your notebook:

!pip install transformers[torch]
!pip install accelerate -U
import os
os._exit(0)

Then when the runtime restarts delete this cell and run the code again. Atleast, this error should go away.

1 Like
3

Thank you so much. This helps me resolve the problem.

1 Like