@sgugger So if I understand this correctly, in this post Checkpoints and disk storage - #9 by sgugger you actually “confirm” that the proposed configuration from @karthikcs will actually achieve the asked functionality (from the original question), namely having
save_total_limit=1
will actually save and load ONLY the best performing checkpoint (save because the best is always on top and “never gets deleted”, load because there is only one endpoint left). Is this correct?