Training AutoModelForCausalLM in a Seq2Seq task

sd3ntato June 25, 2023, 2:00pm 1

hello,
I was wondering if there is any way to take a model from AutoModelForCausalLM and fine-tune it in a Seq2Seq task

Topic		Replies	Views
Can you fine tune a CausalLM model (GPT2) to seq2seq, redefining the architecture or do I need to retrain the model from scratch? 🤗Transformers	0	289	February 28, 2024
How to use CausalLM model to pre-train, and use SequenceClassification model to fine-tune? Beginners	2	650	August 31, 2023
Finetuning model with smaller sequence size and Dmodel Models	0	331	April 15, 2021
Turn a classification model into seq2seq model? Beginners	1	360	December 11, 2022
Fine-tuning with Different Model Heads Intermediate	4	544	April 30, 2024