I am trying to fine tune Distilbert with checkpointing, stopping criteria, accuracy curves etc. The main way to do that in Pytorch appears to be via Lightning and to do that I will need to add a decent amount of wrapper code. Wondering if there already exists a standard implementation of popular LLMs that allows for checkpointing?