Can I get logits for each sequence I acqired from model.generate()?

Beginners
2

Hi, one way to do that is to modify generation_utils

For examples, we can extract logits of greedy search in the scores variable (there are many options on next-token search eg. greedy, beam or sample searches)