GPT-GPT encoder decoder

Yeah May 4, 2021, 9:37am 1

May i create an encoder decoder in transformer, in which the encoder and decoder part both are GPT2.
Anyone has suggestion for that?

Thanks a lot and appreciate for any feedback.

Topic		Replies	Views
I want to use EncoderDecoderModel.from_pretrained() where time-series-transformer is the encoder and gpt2 as decoder Intermediate	3	218	February 20, 2024
How to add encoder's last hidden state to GPT2 as encoder-decoder attention Beginners	0	373	January 31, 2023
Difference between transformer encoder and decoder Models	1	11512	March 12, 2021
Pre-trained Model for Text Translation 🤗Transformers	0	455	June 30, 2022
Encoder-decoder transformers, Models	0	322	April 30, 2021