Hi, I’m surprised not to find any info on this yet, but… I guess I’m the first one to ask: Is there any way to make Accelerate work with a PyTorch Lightning based code? (Or a recommended way to convert from the latter to the former?)
Up until posting this, I’ve been assuming the answer is “No”, and have begun “ripping out” all my Lightning stuff and converting my pl.Trainer
module to a straight-PyTorch module in order to match up with the Accelerate
examples I’ve seen, and have begun writing a “manual” PyTorch training loop to replace the trainer.fit()
from Lightning.
But…is that the only/best way to do it? Figured it was worth asking before I got too far along in this (kind of) “refactoring”.