Hello, I am running an example summarization training task taken from here (official HuggingFace example) on a multi-GPU machine, using the following versions: torch==1.11.0+cu113 and transformers==4.20.1. The only difference is that instead of using google/mt5-small as model I am using facebook/b…

HuggingFace summarization training example notebook raises two warnings when run on multi-GPUs

brando August 17, 2022, 3:38pm 6

Topic		Replies	Views
Getting error while resuming the training with a single GPU Beginners	1	699	June 13, 2024
Cannot use Datasets.map on multi-gpu during evaluation Beginners	3	2711	July 1, 2024
Using huggingface transformers trainer method for hugging face datasets 🤗Datasets	1	1022	April 15, 2024
Get UserWarning: "Was asked to gather along dimension 0, but all input tensors were scalars; will instead unsqueeze and return a vector" when run official example code run_mlm.py 🤗Transformers	1	2129	November 17, 2022
Huggingface Distributed Training with Accelerate Beginners	1	843	May 11, 2023