Which model/class should I use to fine tune GPT2 for text classification?

Wenzhong2005 · June 27, 2023, 8:35pm

Hi, I’m planning to fine tune a pre-trained GPT-2 model with our own private data to build a text classifier. I noticed that there are several classes in the transformer module for GPT-2 pre-trained models, namely GPT2Model, GPT2LMHeadModel, GPT2ForSequenceClassification. Which one should I use for my use case?

Topic		Replies	Views
Text classification and generation from the same model Beginners	1	454	July 27, 2023
Training a pre-trained model and fine-tuning it later Beginners	0	124	March 11, 2024
Task-specific fine-tuning of GPT2 Research	0	953	April 22, 2021
Which model can I use fine tune on data for text generation given input-output pair? Beginners	0	566	June 15, 2023
GPT-2 fine-tuning Beginners	0	943	June 12, 2023

Which model/class should I use to fine tune GPT2 for text classification?

Related Topics