Custom model with two pretrained models fails multi GPU training when using the Trainer

shamanez March 2, 2023, 8:59am 1

How can I wrap the custom model class to use the trainer in multiple GPU settings

Topic		Replies	Views
Training using multiple GPUs Beginners	20	18116	February 25, 2024
Custom trainer does not work on multiple GPUs 🤗Transformers	1	1214	December 21, 2021
Trying to train BERT using input_embeds as data fails on multiple GPUs 🤗Transformers	0	681	November 17, 2021
Trainer use multigpu 🤗Transformers	0	450	July 29, 2021
Setting specific device for Trainer Beginners	23	28141	April 3, 2024