Is there a way to let HF generate tokens based on the last hidden states?
Related topics
| Topic | Replies | Views | Activity | |
|---|---|---|---|---|
| Attention and hidden state details from t5 | 0 | 197 | November 12, 2020 | |
| Avoid recalculating hidden states between generate calls? | 3 | 1214 | March 30, 2023 | |
| T5.generate() cannot get hidden states although output_hidden_states=True | 0 | 554 | July 9, 2022 | |
| Streaming token output from models like T5 | 7 | 12249 | June 7, 2023 | |
| BLIP2 GreedySearchDecoderOnlyOutput, how can I extract the activations of a certain hidden layer? | 0 | 146 | July 5, 2023 |