Custom model with two pretrained models fails multi GPU training when using the Trainer

shamanez March 2, 2023, 8:59am 1

How can I wrap the custom model class to use the trainer in multiple GPU settings

Topic		Replies	Views
Training using multiple GPUs Beginners	20	19997	February 25, 2024
A custom trainer for multi-task learning? 🤗Transformers	1	807	September 18, 2024
Custom trainer does not work on multiple GPUs 🤗Transformers	1	1420	December 21, 2021
Trying to train BERT using input_embeds as data fails on multiple GPUs 🤗Transformers	0	795	November 17, 2021
Jointly train two-stage models using Trainer 🤗Transformers	3	1868	March 2, 2023