Finetuning on base or instruct model?

Hi, i want to finetune this model, should i use the base model or the instruct fine tuned model?

I’ve seen some voices saying that we should fine tune on the base model so that the data used to fine tune the instruct model would not contaminate my dataset or mess with the prompt format that i’m using?

Can anyone clarify this issue for me? Thank you.

1 Like