Mistral for sequence classificaiton

Is possible to use mistral for sequence classification even if it’s a decoder only model?

Yes, you can use Mistral and other decoder models for sequence classification. See MistralForSequenceClassification in https://huggingface.co/docs/transformers/model_doc/mistral.