Saving weights while finetuning is on

I have started finetuning using SFT and deepspeed. I have an automatic saving strategy at 500 steps. However, my calculations have gone wrong, and trying the model will take time. Is there any way that I can access the last checkpoint of the model at any time during training?