We have setup an aws ec2 instance and initialized https://huggingface.co/Qwen/Qwen2-VL-7B-Instruct and mistralai/Pixtral-12B-2409 · Hugging Face models. when we create ami from these vm and create new instance, the transformers library isn’t able to load the pretrained models. When i delete .cache…

Transformers cache not loading from a new vm

John6666 October 11, 2024, 8:00am 2

The symptoms are different but the problem could be similar to this.

Topic		Replies	Views
Load model from local cache directory in Sagemaker notebooks Amazon SageMaker	0	461	December 12, 2023
Huggingface Transformer code successfully gets executed on amazon web services but not on other server 🤗Transformers	1	1369	December 20, 2020
Cache large models on GPU instances between reboots Spaces	3	870	February 14, 2023
Load_cache before training 🤗Transformers	0	205	February 28, 2023
Models take all ubuntu free space Beginners	3	2362	May 17, 2021