Custom model with two pretrained models fails multi GPU training when using the Trainer

shamanez March 2, 2023, 8:59am 1

How can I wrap the custom model class to use the trainer in multiple GPU settings

Topic		Replies	Views
Training using multiple GPUs Beginners	20	20150	February 25, 2024
Finetuning GPT2 using Multiple GPU and Trainer 🤗Transformers	14	6794	May 22, 2023
How can I use trainer.train() in runpod's multi gpu? 🤗Transformers	0	422	August 4, 2023
Multiple gpu training 🤗Transformers	1	2739	August 10, 2024
Jointly train two-stage models using Trainer 🤗Transformers	3	1923	March 2, 2023