I have been trying to finetune the decoder by inserting an adapter after the ffn block of a large encoder-decoder model for the MT task, but the blue score is bad when compared to full finetuning. Please, can anyone suggest a better method to finetune or refer me to some resources to finetune the d…

How to parameter efficient finetune Decoder in encoder-decoder model?

yasmineee July 27, 2024, 7:45pm 2

have you tried fixing it? i faced the same exact problem

Topic		Replies	Views
How to parameter efficient finetune Decoder in encoder-decoder model Beginners	1	219	April 23, 2024
Problem with Adding LayerNorm after BART's Encoder for Summarization 🤗Transformers	0	392	May 16, 2022
About finetuning whisper 🤗Transformers	0	210	May 5, 2023
Use BertLMHeadModel to finetunning a language model 🤗Transformers	0	325	March 30, 2021
Partially fine-tuning an encoder in an encoder-decoder transformer 🤗Accelerate	0	1285	August 17, 2021