Hi folks, How would you best recommend that I pass gradients through generate? below is a rough code snippet explaining the objective. I am thinking that I could take the hypo_ids directly from the model output (instead of from generate), but this is no longer natural because teacher-forcing is us…

Carrying Gradients Through Generate

patrickvonplaten November 2, 2020, 12:55pm 5

This should also be interesting: Big `generate()` refactor

Topic		Replies	Views
Disparity between output from `forward` and `generate` for greedy search (using Whisper) 🤗Transformers	3	1350	August 11, 2024
How to output loss from model.generate()? 🤗Transformers	16	6069	January 7, 2025
How to generate without decoding? 🤗Transformers	1	371	December 13, 2023
Language model gradients sensitive to target value/length Research	0	341	June 16, 2023
A potential in-place operation that caused an RuntimeError 🤗Transformers	1	2316	January 19, 2021