Can we fine-tune T5 for multiple tasks?

I am fine-tuning T5 for multiple tasks so that they work together. I want the models to work together. For example, summarization and translation should work together. The summarized text is the input to the translation model and gets translated.

Q1. Can we train T5 with different datasets and prefixes and expect it to work this way?

Q2. Is it possible to concatenate the models and make them one single model?

1 Like