How can I obtain the logits via model.generate()?

🤗Transformers
3

Thank you, I just found the solution:

        output = model.generate(**inputs, max_new_tokens=40, return_dict_in_generate=True, output_scores=True)

        sequence = output.sequences
        scores = output.scores # logits of the generated tokens
1 Like