Fnet with upper case

[natank]

Good morning.

I need to run a model which I wish to speed. I though about Fnet but i wish to hav a tokenizer that preserves the upper cases as well.
What is the optimal way?

Thanks
Natan