Good news is move the from_pretrained from outside of the train loop and use the already downloaded one available and it will run fine. The bug stems from that function specifically.
For keeping an eye on progress:
1 Like