Thanks for that pointer.
If I’m reading the code right, I could save the current transform function by storing the dict returned by dataset.format(), remove the transform and let the trainer advance to the current checkpoint, and then use dataset.set_format() with the stored format values for args to reload the original transform.
Would that get me back to the checkpoint faster and still give me the same values from the dataset?