ControlNet SDXL checkpoint

aniket2025 · June 12, 2025, 2:05pm

I plane to usi the stable diffusion web ui along with SDXL and controlnet for SDXL for inpainting. However, not finding the checkpoint for controlnet sdxl inpainting.

How or where can i find and download it?

I have came across the destitech (Jean-Loup Maillet) repo where i find a safetensor file like: diffusion_pytorch_model.fp16.safetensors · destitech/controlnet-inpaint-dreamer-sdxl at main

I am not sure it is the controlnet model checkpoint or not. Using these I did not get any result

John6666 · June 12, 2025, 3:14pm

How about this unified version?

John6666 · June 13, 2025, 5:30am

I found an example for destitech/controlnet-inpaint-dreamer-sdxl.

Incidentally, StablePy’s source code is also useful as a catalog of existing control nets.

github.com/R3gm/stablepy

stablepy/diffusers_vanilla/constants.py

main


      
                  "inpaint": StableDiffusionXLPAGInpaintPipeline,
                  "controlnet": StableDiffusionXLControlNetPAGPipeline,
                  # "adapter": StableDiffusionXLAdapterPAGPipeline,
                  "controlnet_img2img": StableDiffusionXLControlNetPAGImg2ImgPipeline,
                  # "controlnet_inpaint": StableDiffusionXLControlNetPAGInpaintPipeline,
                  # "controlnet_union+": StableDiffusionXLControlNetUnionPAGPipeline,
                  # "controlnet_union+_inpaint": StableDiffusionXLControlNetUnionPAGInpaintPipeline,
              },
          }
          
          CONTROLNET_MODEL_IDS = {
              "openpose": ["lllyasviel/control_v11p_sd15_openpose", "r3gm/controlnet-openpose-sdxl-1.0-fp16"],
              "canny": ["lllyasviel/control_v11p_sd15_canny", "r3gm/controlnet-canny-scribble-integrated-sdxl-v2-fp16"],
              "mlsd": ["lllyasviel/control_v11p_sd15_mlsd", "r3gm/controlnet-union-sdxl-1.0-fp16"],
              "scribble": ["lllyasviel/control_v11p_sd15_scribble", "r3gm/controlnet-canny-scribble-integrated-sdxl-v2-fp16"],
              "softedge": ["lllyasviel/control_v11p_sd15_softedge", "r3gm/controlnet-union-sdxl-1.0-fp16"],
              "segmentation": ["lllyasviel/control_v11p_sd15_seg", "r3gm/controlnet-union-sdxl-1.0-fp16"],
              "depth": ["lllyasviel/control_v11f1p_sd15_depth", "r3gm/controlnet-union-sdxl-1.0-fp16"],
              "normalbae": ["lllyasviel/control_v11p_sd15_normalbae", "r3gm/controlnet-union-sdxl-1.0-fp16"],
              "lineart": ["lllyasviel/control_v11p_sd15_lineart", "r3gm/controlnet-union-sdxl-1.0-fp16"],
              "lineart_anime": ["lllyasviel/control_v11p_sd15s2_lineart_anime", "r3gm/controlnet-lineart-anime-sdxl-fp16"],

Topic		Replies	Views
SD XL Multi ControlNet Inpainting in diffusers 🧨 Diffusers	0	2055	September 11, 2023
Looking for: Controlnets reference_only model Models	3	42	May 21, 2025
SDXL inpainting checkpoint generating dark lighting samples 🧨 Diffusers	0	544	January 19, 2024
SDXL img2img controlnet not in release 0.20.2? 🧨 Diffusers	1	605	September 4, 2023
Multi_controlnet + inpaint 🧨 Diffusers	5	3577	November 12, 2023

ControlNet SDXL checkpoint

Related topics