Using FluxControlNetModel with LoRAs?

I am attempting to set up a pipeline with FluxControlNetModel/FluxControlNetPipeline and usage of load_lora_weights, but it is unclear to me if this is properly supported?

1 Like

Currently, their simultaneous use is not properly supported; even the github version may or may not work depending on the commit.
If the versions of Diffusers and PEFT are off by even one commit each, you can expect bugs. I have also succeeded in getting it to work, but I don’t remember the combination that works.
Anyway, if you look for a combination that works, it should exist, but I don’t think it simply doesn’t work with the current latest version. This depends on the implementation of the control net, so it is actually an even more detailed condition.