Hi @dpernes !
This is a great question! In the past, I’ve seen similar threads about sequences-scores do not compute what is expected for beam_search and also this one about the mismatch between the log probabilities of the beam search and the compute transitions. I believe they updated this API and is now easier to get these scores.
I’m going to look into your examples and try to understand a bit better what’s going on. What transformers version are you using?