Almost same as fine-tuning example, while running trainer.train()
. it takes so long(tens of minutes) before the model starting training. is that normal?
And, how could we use apex(torch) for faster fine-tuning using trainer
?
3 Likes
set group_by_length=False, fix this. seems that group by length takes too much time
2 Likes
You can use this parametr with TRUE, but your Dataset must have column âlengthâ. View this - length_column_name
1 Like