Fine-tunning techniques

I studied nlp specialization and hugging face course and i learnt how to fine-tune using LoRA and QLoRA, and how to quantize using BnB and the mathematical intuition behind them.
Now i want to start in a fine-tuning course but I don’t know what should i exactly study in fine-tuning.
So if anyone can provide techniques that should i study

1 Like