Hi folks, How would you best recommend that I pass gradients through generate? below is a rough code snippet explaining the objective. I am thinking that I could take the hypo_ids directly from the model output (instead of from generate), but this is no longer natural because teacher-forcing is us…

Carrying Gradients Through Generate

patrickvonplaten November 2, 2020, 12:55pm 5

This should also be interesting: Big `generate()` refactor

Topic		Replies	Views
How to output loss from model.generate()? 🤗Transformers	14	4016	April 25, 2024
BART learns well, loss decreases, but prediction output is weird 🤗Transformers	2	89	March 3, 2024
T5 - model.generate() issue Beginners	2	522	March 18, 2024
How to get the score for a generated sentence from BartForConditionalGeneration Models	0	498	March 1, 2022
T5 user defined loss function Beginners	11	4399	September 23, 2020