Hi, I cannot for the life of me figure out what is going wrong. I am following the tutorial 08 distributed training and when sending the job to AWS the error continually shows up. I am running it on a local jupyter notebook with these setups: [image] … [1,0]:storing https://huggingface.co/faceb…

Distributed Training run_summarization.py

philschmid July 29, 2021, 7:15am 3

For me it worked with ml.p3.16xlarge and batch_size of 2

Topic		Replies	Views
Distributed Training on Sagemaker Amazon SageMaker	13	2728	August 5, 2021
Sagemaker gpt-j train file error Amazon SageMaker	27	2912	February 22, 2024
Multi Instance Training Error Amazon SageMaker	5	1584	October 29, 2021
OutOfMemoryError: CUDA out of memory while trying to replicate this notebook on sagemaker: https://github.com/huggingface/notebooks/blob/main/sagemaker/24_train_bloom_peft_lora/sagemaker-notebook.ipynb Amazon SageMaker	4	1687	June 16, 2023
Distributed training with Sagemaker 🤗Transformers	0	305	June 26, 2023