Fine tuning the already fine tuned model

Is it possible for fine tuning the already fine tuned model without losing previous features??

Suppose i fine-tune a model on “squad” dataset then I want to Incremental fine-tune the same model on some other dataset having same/different data formate and hyperparameters, does this means now model is fine-tuned on 2 datasets??? or it forgets the “squad” dataset when I fine tune on the second dataset.

Please acknowledge me over this
@sgugger
@amyeroberts