Text classification and generation from the same model

Beginners
1

Hi,

I’m looking for some advice on whether it is possible to fine-tune a model to both classify and generate text. I have a labelled dataset of text and have had success fine-tuning BERT and GTP-2 to predict the labels. I have also been able to successfully fine-tune multiple GPT-2 models to generate text of each label-type.

For various reasons, I would ideally like to make predictions and generate texts from the same fine-tuned model. Is this possible?

Any advice would be appreciated.

Stefan

2

Hi @StefanL, I am a beginner, and I was trying to fine-tune the model to generate text. It will be a great help if you will be able to provide your notebook to me.
I am ready to use any model of the LlamaForCasualLM architecture; any dataset will be fine for me. I just want to understand the Concept and practical Implementation Behind that.