Transformers with protein data

Hi all,

I hope you are well.

I am wondering is it possible to use transformers to build a model to classify protein data? Like for example, using FASTA files as input?

Much appreciated, in advance.

Kind Regards,
Zakia