Generate tokens given hidden states

zekeZZ August 28, 2023, 10:59pm 1

Is there a way to let HF generate tokens based on the last hidden states?

Topic		Replies	Views
Avoid recalculating hidden states between generate calls? 🤗Transformers	3	861	March 30, 2023
The hidden_states when i use model.generate 🤗Transformers	0	220	February 14, 2024
Conditional generation from hidden states only Beginners	0	281	February 22, 2022
How to get hidden states when using custom Pipeline? Beginners	3	1584	January 3, 2023
Understanding model output arrays Beginners	0	476	August 28, 2022