It takes so long before the model start training, wav2vec2 fine-tuning

🀗Transformers
1

Almost same as fine-tuning example, while running trainer.train(). it takes so long(tens of minutes) before the model starting training. is that normal?
And, how could we use apex(torch) for faster fine-tuning using trainer?

3 Likes
2

set group_by_length=False, fix this. seems that group by length takes too much time

1 Like
3

You can use this parametr with TRUE, but your Dataset must have column “length”. View this - length_column_name

1 Like