I’m following the HF nlp course and I’m coming across a hurdle as I try to establish my ‘mental model’. Specifically, the tutorial calls out that ‘Decoder models are suited for text generation from a prompt’ and that ‘Encoder-decoder models are suited for input summarization’. In my mind, I’m imag…

Decoder vs Encoder-decoder clarification

dblakely June 26, 2023, 2:56pm 2

Could you clarify what you’re asking in this part of your post?

Are you asking what’s the difference between a “prompt” (the input to a decoder-only) and the input to an encoder-decoder model?

Topic		Replies	Views
How to properly prompt the decoder? 🤗Transformers	0	844	May 20, 2023
Need help understanding input of model in generation 🤗Transformers	0	258	March 14, 2022
Could someone explain the difference between encoder-only and encoder-decoder models in the context of question answering? Beginners	3	106	October 24, 2025
Decoder only model - how to have it not include the prompt in its output? 🤗Transformers	3	771	May 15, 2024
Difference between transformer encoder and decoder Models	1	11971	March 12, 2021