I’m not familiar with text classification, but it seems that a normal LM would be sufficient for classification with that dataset, rather than an LLM.
https://huggingface.co/models?pipeline_tag=text-classification&library=transformers&sort=trending
Also, the leaderboards is useful for comparing LLM performance.