Is it possible for fine tuning the already fine tuned model without losing previous features??
Suppose i fine-tune a model on “squad” dataset then I want to Incremental fine-tune the same model on some other dataset having same/different data formate and hyperparameters, does this means now model is fine-tuned on 2 datasets??? or it forgets the “squad” dataset when I fine tune on the second dataset.
Please acknowledge me over this
@sgugger
@amyeroberts