Custom model with two pretrained models fails multi GPU training when using the Trainer

shamanez March 2, 2023, 8:59am 1

How can I wrap the custom model class to use the trainer in multiple GPU settings

Topic		Replies	Views
Training using multiple GPUs Beginners	20	20180	February 25, 2024
Finetuning GPT2 using Multiple GPU and Trainer 🤗Transformers	14	6798	May 22, 2023
How can I use trainer.train() in runpod's multi gpu? 🤗Transformers	0	423	August 4, 2023
Jointly train two-stage models using Trainer 🤗Transformers	3	1926	March 2, 2023
Trainer use multigpu 🤗Transformers	0	510	July 29, 2021