\multi-node finetuning with Trainer

omarabb315 July 27, 2022, 8:29am 1

How can I use the Trainer of HuggingFace to fine-tune a model of about 1.47B parameters, using two servers (nodes) each with 2 GPUs of RTX 8000 48GB?
Thank you

Topic		Replies	Views
Train Mask2Former model using Trainer class 🤗Transformers	0	378	November 29, 2023
Using Huggingface-Trainer with 2 GPUs (Endless Loop) Beginners	0	265	October 10, 2023
Boilerplate for Trainer using torch.distributed Beginners	4	1895	January 11, 2022
Multiple gpu training 🤗Transformers	1	120	August 10, 2024
Jointly train two-stage models using Trainer 🤗Transformers	3	1697	March 2, 2023

\multi-node finetuning with Trainer

Related Topics