Finetuing GPT model?

🤗Transformers
1

Hi does someone know a fine tuning example with the HF trainer API?

Have never fintined a gpt before so any tipis is much appreciated

2

I’ve never used GPT models before. However, if they are available on huggingface, I guess fine-tuning it won’t be different than fine-tuning any other model. I use PyTorch Lightning for training and replacing any huggingface models with each other wouldn’t change the process I guess…

3

Thanks for the reply man,

i was just wondering about the hyper paramtres used during the fine tuning stage.

Is there any guide on that?