When you pass encoder_outputs directly, generate() doesn’t know your input length or tokens so it just generates until max_length or EOS. It’s not continuing from anything, just starting fresh based on the encoder output.
1 Like