Custom model with two pretrained models fails multi GPU training when using the Trainer

shamanez March 2, 2023, 8:59am 1

How can I wrap the custom model class to use the trainer in multiple GPU settings

Topic		Replies	Views
Training using multiple GPUs Beginners	20	19970	February 25, 2024
A custom trainer for multi-task learning? 🤗Transformers	1	799	September 18, 2024
Custom trainer does not work on multiple GPUs 🤗Transformers	1	1419	December 21, 2021
Trying to train BERT using input_embeds as data fails on multiple GPUs 🤗Transformers	0	794	November 17, 2021
Jointly train two-stage models using Trainer 🤗Transformers	3	1857	March 2, 2023