We have setup an aws ec2 instance and initialized https://huggingface.co/Qwen/Qwen2-VL-7B-Instruct and mistralai/Pixtral-12B-2409 · Hugging Face models. when we create ami from these vm and create new instance, the transformers library isn’t able to load the pretrained models. When i delete .cache…

Transformers cache not loading from a new vm

John6666 October 11, 2024, 8:00am 2

The symptoms are different but the problem could be similar to this.

Topic		Replies	Views
No space left on device when trying to run batch inference - HF not using EBS storage? Amazon SageMaker	2	972	February 3, 2022
HuggingFace with Sagemaker tutorial doesn't work Amazon SageMaker	5	1170	August 25, 2021
"no space left on device" when downloading a large model for the Sagemaker training job Amazon SageMaker	4	4059	July 18, 2024
TRANSFORMER_CACHE issue inside jupyter notebook 🤗Transformers	1	1010	July 25, 2023
Models take all ubuntu free space Beginners	3	2093	May 17, 2021