Sequence analysis

I am working on event sequence analysis in the area of multiclass classification. Is the Transformers library the right one to explore?

The event space is not big and I can use one-hot eoncding or tokenizer to represent them. The pre-trained models are probably not useful for me. Please let me know if I am at the right place. Thank you.