T5 Finetuning Tips

How is the AdafactorSchedule supposed to be used? in particular how often do I call the scheduler? e.g. every epoch or maybe every 1000 steps?