Converting diffusers model to inpaint model?

Diffusers has a script convert_original_stable_diffusion_to_diffusers.py that can convert a .ckpt file to a diffusers-compatible model. However, this new model (well, neither the .ckpt nor the new model) cannot be used for inpainting.

Automatic 1111’s UI has an internal “hijack” method to hack a model loaded from a .ckpt file, that is not meant for inpainting into a new model that can be used for inpainting. This is done on the fly without creating a new .ckpt file.

Is there a way to “hijack” a diffusers model? I’m not sure where I would make the hijack.

1 Like

Did you figure it out?