Hello, I have a encoder-decoder transformer model using normal pytorch functions (nn.TransformerEncoder, nn.TransformerDecoder) which I have managed to train. I am hoping to using huggingface’s implementation of beam search with this model. So the question is, is there a way to add the generation …

Generation utils for pytorch transformers

dnathani April 1, 2023, 6:39am 2

I am looking for something similar. Were you able to find a solution for this?

Topic		Replies	Views
How to use the generation_utils.generate? 🤗Transformers	0	282	April 28, 2022
How to use the encoder_outputs embeding to generate a sentence through decoder 🤗Transformers	0	207	October 29, 2022
Obtain step by step outputs of model.generate 🤗Transformers	0	744	June 28, 2022
Using custom models (not necessarily transformer based) with generate() and sampling Beginners	2	1223	March 1, 2022
How to use decoder generation upon features and not token ids? 🤗Transformers	0	220	August 8, 2022