Im trying to load the image encoder from this repository
Using this line of code:
image_encoder = PaintByExampleImageEncoder.from_pretrained(“Fantasy-Studio/Paint-by-Example”, subfolder=“image_encoder”)
However I get the error:
OSError: Fantasy-Studio/Paint-by-Example does not appear to have a file named config.json.
Even though clearly there is one there in the above link. What is wrong?
hi @Alpha-Romeo ,
I think you can do this, where you need to explicitly pass CLIP config
from diffusers.pipelines.paint_by_example import PaintByExampleImageEncoder
from transformers import CLIPVisionConfig
config = CLIPVisionConfig.from_pretrained("openai/clip-vit-large-patch14")
image_encoder = PaintByExampleImageEncoder(config)
Thanks, this resolved the error!