How to use decoder generation upon features and not token ids?


I am trying to use the generate function on a BertLM model using beam search using embeddings and not upon the inputs ids and I can’t make it work. The usecase is as follows: I want to insert features from external model for the generation process (for example, as done in frozen’s paper). How can I do it? is it possible?