Hello, I am running an example summarization training task taken from here (official HuggingFace example) on a multi-GPU machine, using the following versions: torch==1.11.0+cu113 and transformers==4.20.1. The only difference is that instead of using google/mt5-small as model I am using facebook/b…

HuggingFace summarization training example notebook raises two warnings when run on multi-GPUs

brando August 17, 2022, 3:38pm 6

Topic		Replies	Views
Using huggingface transformers trainer method for hugging face datasets 🤗Datasets	1	777	April 15, 2024
Boilerplate for Trainer using torch.distributed Beginners	4	1523	January 11, 2022
BART finetuning for summarization without seq2seq trainer Beginners	1	696	October 31, 2022
Masked language model for BART (Not BERT) 🤗Transformers	5	1229	July 5, 2022
Discrepancy in Model Inference: Local vs. Hugging Face Model Hub 🤗Transformers	1	534	December 27, 2023