Can we Finetune the Finetuned Model

Hi, So this is my problem statement.
Suppose I have a dataset which comprises of 17 different domains query and answers. After 2-3 weeks of collecting another 3 domains query and its answers.
What should by my best approach for this

  1. Finetune the model again and again with previous 20 domains data.
  2. Finetune the 17 domains finetuned model with 3 extra domains query and answers.

If there is any other options kindly share your views.