EncoderDecoderModel for token classification

Is there some way I can use an EncoderDecoderModel for token classification? I know of course that you can use any xxxForTokenClassification model to do token classification. The reason I do not want to use such a xxxForTokenClassification model is that I want to use beam search to find an optimal sequence of token labels. As far as I can gather, that is not possible with a xxxForTokenClassification model.