Hi folks, How would you best recommend that I pass gradients through generate? below is a rough code snippet explaining the objective. I am thinking that I could take the hypo_ids directly from the model output (instead of from generate), but this is no longer natural because teacher-forcing is us…

Carrying Gradients Through Generate

patrickvonplaten November 2, 2020, 12:55pm 5

This should also be interesting: Big `generate()` refactor

Topic		Replies	Views
How to output loss from model.generate()? 🤗Transformers	16	5633	January 7, 2025
Passing output of BART to another model Beginners	0	229	September 24, 2022
BartForConditionalGeneration "logits" shape is wrong/unexpected 🤗Transformers	4	899	November 11, 2020
[Bart] Question for BartModel Output shape Beginners	2	372	July 20, 2020
T5 Model Generate and Model Outputs Vastly Different Beginners	1	751	September 11, 2022