About Lora Training Script


I want to use diffusers/train_dreambooth_lora.py at main · huggingface/diffusers · GitHub. However I am not sure what ‘instance_prompt’ and ‘class_prompt’ is. What is their difference and how is the logic of a ‘class’ is used in this context?

Also do I have to name the images in my dataset like ‘dog in the style of xyz.png’? I have seen some tutorials do this and some skip this. Would naming them help the training?

hey @demegire!

the instance prompt and class prompt is documented in the README

I don’t know off the top of my head if giving additional captions to your dataset will help or not. We don’t have additional prompts for our example dataset. Afaik, there’s not consensus rules on it. I recomend experimenting