GPT-GPT encoder decoder

Yeah May 4, 2021, 9:37am 1

May i create an encoder decoder in transformer, in which the encoder and decoder part both are GPT2.
Anyone has suggestion for that?

Thanks a lot and appreciate for any feedback.

Topic		Replies	Views
I want to use EncoderDecoderModel.from_pretrained() where time-series-transformer is the encoder and gpt2 as decoder Intermediate	3	157	February 20, 2024
Transformers for GPT 4 🤗Transformers	1	1072	August 4, 2023
How to decode GPT2 🤗Transformers	3	6052	June 17, 2022
Looking for help with GPT-2 code Models	0	129	February 7, 2024
EncoderDecoderModel generate text for a ViT as encoder 🤗Transformers	0	582	November 27, 2021