I use:
save_total_limit=1
evaluation_strategy=‘steps’
load_best_model_at_end=True
In my very limited experience, as I started in this business a couple of days ago, I believe that save_total_limit=n keeps n+1 models as the best model is always kept and always first. So, if you set it to 1, at any given time you will have the working model and the best model.