How to use LoRA with Flax Stable Diffusion Img2Img Pipeline when using diffusers?

pipeline, params = FlaxStableDiffusionImg2ImgPipeline.from_pretrained(
    "CompVis/stable-diffusion-v1-4",
    revision="flax",
    dtype=jnp.bfloat16,
    safety_checker=None,
    load_attn_procs="sayakpaul/civitai-light-shadow-lora",
)

The above code does nothing.

I cannot use load_attn_procs or load_lora_weights with unet or pipeline as they do not exist on FlaxStableDiffusionImg2ImgPipeline.

How can I use LoRA with it then?

Would love to find out if we can use Lora with the Jax pipeline. Has there been any update on this subject?