\multi-node finetuning with Trainer

omarabb315 July 27, 2022, 8:29am 1

How can I use the Trainer of HuggingFace to fine-tune a model of about 1.47B parameters, using two servers (nodes) each with 2 GPUs of RTX 8000 48GB?
Thank you

Topic		Replies	Views
Train Mask2Former model using Trainer class 🤗Transformers	0	178	November 29, 2023
Boilerplate for Trainer using torch.distributed Beginners	4	1550	January 11, 2022
Jointly train two-stage models using Trainer 🤗Transformers	3	1367	March 2, 2023
Ensemble with `trainer` Beginners	2	671	February 21, 2021
Finetuing GPT model? 🤗Transformers	2	277	August 29, 2021

\multi-node finetuning with Trainer

Related Topics