Problem loading pretrained model that exists


Im trying to load the image encoder from this repository

Using this line of code:

image_encoder = PaintByExampleImageEncoder.from_pretrained(“Fantasy-Studio/Paint-by-Example”, subfolder=“image_encoder”)

However I get the error:
OSError: Fantasy-Studio/Paint-by-Example does not appear to have a file named config.json.

Even though clearly there is one there in the above link. What is wrong?

hi @Alpha-Romeo ,

I think you can do this, where you need to explicitly pass CLIP config

from diffusers.pipelines.paint_by_example import PaintByExampleImageEncoder
from transformers import CLIPVisionConfig

config = CLIPVisionConfig.from_pretrained("openai/clip-vit-large-patch14")
image_encoder = PaintByExampleImageEncoder(config)

Thanks, this resolved the error!

1 Like