Using encoder and decoder portion separately from encoder-decoder

imranq · March 12, 2022, 5:25pm

Is it possible to use only the encoder part of a Seq2Seq model ? I want to do some data analysis on the encoding after training

Similarly for the decoder portion. I want to see what gets generated by inputting random vector inputs

Is this possible using HuggingFace?

Thank you!

bk073 · October 4, 2023, 4:20pm

hi @imranq, were you able to do this?

Topic		Replies	Views
Transformers, am i only using a Encoder for Binary Classification? Beginners	1	1320	January 4, 2021
How to use Seq2seq Trainer with my original "[MASK]" Beginners	2	569	October 22, 2020
Can an EncoderModel be trained on top of a concatenation of BertModel [CLS] embeddings with additional input data using the transformers library? Intermediate	0	393	December 9, 2022
Using decoder only part of pretrained MarianMT (Encoder-Decoder Translation model) 🤗Transformers	2	437	October 18, 2023
Warm-started encoder-decoder models (Bert2Gpt2 and Bert2Bert) Beginners	7	1727	December 15, 2021