ProtTrans actually has models which were trained on 9 programming languages + English language using self-supervised learning.
You can easily fine-tune them on any task and almost all famous programming languages.
For example:
3 Likes