T5: classification using text2text?

Yes, it is possible and called multi-label classification. See e.g. the following link. https://github.com/NielsRogge/Transformers-Tutorials/blob/master/BERT/Fine_tuning_BERT_(and_friends)_for_multi_label_text_classification.ipynb