Posting this here for visibility. What if you want to decode the output of a generative seq2seq model (like T5, BART, etc.) yourself, without using the .generate() method? The code example below illustrates this. Suppose that the model is given a long text, for which it needs to generate a summary.…

Generate without using the generate method

L-jasmine January 17, 2025, 2:36pm 9

Thank you so much for your post

1 Like