Trainer being very slow to init training setting group_by_length to True

🤗Transformers
1

I observe a very long time before the training actually starts once Trainer.train being called.
It appears it comes from LengthGroupedSampler used when setting group_by_length to True.

Is there a way to use multiple workers to accelerate this process?

1 Like
2

Hey, did you manage to solve this?

1 Like