Best way to quickly switch ControlNet without affecting other components?

Hi everyone!

I’m trying to quickly switch ControlNet models (e.g., from canny to depth) while keeping the rest of the pipeline (like the base model’s parameters and ip-adapter) unchanged. Currently I’m creating multiple ControlNet instances, but it’s causing high memory usage.

Is there a more efficient way to do this? Maybe something to reduce VRAM usage or avoid reloading everything?

Thanks in advance!

1 Like

I found a simple solution: passing kwargs to .from_pipe works perfectly for switching ControlNet without affecting other components. Thanks to everyone who took the time to read this

1 Like

This topic was automatically closed 12 hours after the last reply. New replies are no longer allowed.