Training from scratch

Regarding the overfitting part, we usually run validation inference in between training to see how well the model is progressing.

Regarding failure modes, I think it’s something the community needs to investigate deeper. Maybe an extensive paper from Karras et al., like they have done many times in the past but for GANs:

1 Like