"No space left on device" when using HuggingFace + SageMaker

philschmid April 4, 2022, 7:23am 13

could you please share your training script? The error is probably similar to the ones in the thread in that you need to adjust the cache_dir for transformers or datasets.

Topic		Replies	Views
SageMaker OS Error No Space Left On Device while trying to train Falcon40B Amazon SageMaker	3	1310	August 24, 2023
"no space left on device" when downloading a large model for the Sagemaker training job Amazon SageMaker	4	5000	July 18, 2024
Sagemaker gpt-j train file error Amazon SageMaker	27	2913	February 22, 2024
OutOfMemoryError: CUDA out of memory while trying to replicate this notebook on sagemaker: https://github.com/huggingface/notebooks/blob/main/sagemaker/24_train_bloom_peft_lora/sagemaker-notebook.ipynb Amazon SageMaker	4	1687	June 16, 2023
HF cache no space left on device 🤗Datasets	5	346	March 31, 2025

"No space left on device" when using HuggingFace + SageMaker

Related topics