Hi everyone!
I’m trying to quickly switch ControlNet models (e.g., from canny to depth) while keeping the rest of the pipeline (like the base model’s parameters and ip-adapter) unchanged. Currently I’m creating multiple ControlNet instances, but it’s causing high memory usage.
Is there a more efficient way to do this? Maybe something to reduce VRAM usage or avoid reloading everything?
Thanks in advance!