Transformers for regression

Greetings!, I hope everyone is doing well. I am working on a regression problem and I am looking forward to using Transformers for it but before jumping into the implementation and all stuff, I am curious did any of you use transformers for a regression problem? I have around 90 features (floating points) and one target. I couldn’t find any paper on transformers for regression problems so please let me know if any of you used transformers for this purpose.

How can I use huggingface transformer library for this purpose all the tokenizers are trained for the text data so I am kinda lost. Any help will be appreciated. Thanks