"No space left on device" when using HuggingFace + SageMaker

MaximusDecimusMeridi April 26, 2022, 8:35pm 36

@philschmid just checking if you want me to create a separate topic for my particular issue? I can summarize everything so far

Topic		Replies	Views
SageMaker OS Error No Space Left On Device while trying to train Falcon40B Amazon SageMaker	3	1358	August 24, 2023
"no space left on device" when downloading a large model for the Sagemaker training job Amazon SageMaker	4	5099	July 18, 2024
Sagemaker gpt-j train file error Amazon SageMaker	27	2965	February 22, 2024
OutOfMemoryError: CUDA out of memory while trying to replicate this notebook on sagemaker: https://github.com/huggingface/notebooks/blob/main/sagemaker/24_train_bloom_peft_lora/sagemaker-notebook.ipynb Amazon SageMaker	4	1710	June 16, 2023
HF cache no space left on device 🤗Datasets	5	526	March 31, 2025