I’m a little confused about the purpose of predict_with_generate. My training losses are always better when I set this to true but I’m under the impression that it’s not supposed to affect training at all.
Also, if I do not specify a compute_metrics function in the Seq2SeqTrainer but keep predict_with_generate set to True, are the training/validation losses computed differently?