Yes exactly.
You can get the format with dataset.format, then you can remove the formatting transform with dataset.reset_format. At this point you can run the for loop that iterates over the dataloader to make it reach the requested checkpoint. Finally after that you can set the transform back with dataset.set_format.
Hope that helps !