Is there a way to let HF generate tokens based on the last hidden states?
Related topics
| Topic | Replies | Views | Activity | |
|---|---|---|---|---|
| The hidden_states when i use model.generate | 4 | 1400 | March 28, 2025 | |
| Avoid recalculating hidden states between generate calls? | 3 | 1157 | March 30, 2023 | |
| Get each generated token last layer hidden state | 3 | 30 | March 16, 2025 | |
| Conditional generation from hidden states only | 0 | 349 | February 22, 2022 | |
| On using the final [CLS] hidden state of RoBERTa | 2 | 2917 | November 9, 2023 |