Hey everyone, I havent seen a similar question, so I am shooting my shot.
I would like to use transfer learning with a domain specific model. However, the most promising model does not support the AutoModelForSeq2Seq. Can I somehow still implement it as Seq2Seq model (e.g. by putting extra layers on top) or am I missing a critical architectural feature that would be needed to turn the model into an autoregressive seq2seq model?
I want to work with snowood1/ConfliBERT-scr-uncased · Hugging Face