Transformers cache not loading from a new vm

John6666 · October 11, 2024, 10:39am

Perhaps unresolved issue?

Model cache does not work

opened 05:46PM - 21 Feb 24 UTC

closed 08:04AM - 05 Apr 24 UTC

### System Info I am ubuntu, torch = "2.0.0" The following code always re-do…wnload the models instead of re-using the cached files: ` adapter = T2IAdapter.from_pretrained("TencentARC/t2i-adapter-canny-sdxl-1.0", torch_dtype=torch.float16, varient="fp16").to(accelerator.device) model_id = 'stabilityai/stable-diffusion-xl-base-1.0' logger.info(f"model loading..") euler_a = EulerAncestralDiscreteScheduler.from_pretrained(model_id, subfolder="scheduler") logger.info(f"model loading...") vae = AutoencoderKL.from_pretrained("madebyollin/sdxl-vae-fp16-fix", torch_dtype=torch.float16) logger.info(f"model loading....") pipe = StableDiffusionXLAdapterPipeline.from_pretrained( model_id, vae=vae, adapter=adapter, scheduler=euler_a, torch_dtype=torch.float16, variant="fp16" ).to(accelerator.device) pipe.enable_xformers_memory_efficient_attention() logger.info(f"model weights loading") pipe.load_lora_weights( "stabilityai/stable-diffusion-xl-base-1.0", weight_name="sd_xl_offset_example-lora_1.0.safetensors" )` I also tried with the `cache_dir` param but same result. <img width="1377" alt="Screenshot 2024-02-21 at 11 32 22 AM" src="https://github.com/huggingface/transformers/assets/13439477/562c4f1e-b033-4c03-883b-9dcf3b6a579a"> ### Who can help? _No response_ ### Information - [ ] The official example scripts - [ ] My own modified scripts ### Tasks - [ ] An officially supported task in the `examples` folder (such as GLUE/SQuAD, ...) - [ ] My own task or dataset (give details below) ### Reproduction ` adapter = T2IAdapter.from_pretrained("TencentARC/t2i-adapter-canny-sdxl-1.0", torch_dtype=torch.float16, varient="fp16").to(accelerator.device) model_id = 'stabilityai/stable-diffusion-xl-base-1.0' logger.info(f"model loading..") euler_a = EulerAncestralDiscreteScheduler.from_pretrained(model_id, subfolder="scheduler") logger.info(f"model loading...") vae = AutoencoderKL.from_pretrained("madebyollin/sdxl-vae-fp16-fix", torch_dtype=torch.float16) logger.info(f"model loading....") pipe = StableDiffusionXLAdapterPipeline.from_pretrained( model_id, vae=vae, adapter=adapter, scheduler=euler_a, torch_dtype=torch.float16, variant="fp16" ).to(accelerator.device) pipe.enable_xformers_memory_efficient_attention() logger.info(f"model weights loading") pipe.load_lora_weights( "stabilityai/stable-diffusion-xl-base-1.0", weight_name="sd_xl_offset_example-lora_1.0.safetensors" )` ### Expected behavior use the cached models/files and not download any files from the internet

I wonder if it’s possible to avoid this by manually clearing the cache before execution.

Topic		Replies	Views
Load model from local cache directory in Sagemaker notebooks Amazon SageMaker	0	460	December 12, 2023
Cache large models on GPU instances between reboots Spaces	3	862	February 14, 2023
"No space left on device" when using HuggingFace + SageMaker Amazon SageMaker	39	25643	October 10, 2023
Load_cache before training 🤗Transformers	0	203	February 28, 2023
Huggingface Transformer code successfully gets executed on amazon web services but not on other server 🤗Transformers	1	1364	December 20, 2020

Transformers cache not loading from a new vm

Related topics