Looking for a Translation Model for English to 100+ Languages, Comparable to DeepL or Google, for Local Deployment

Research
1

Hello everyone,

I am working on a project where I need to translate text from English into over 100 different languages. The translation quality needs to be comparable to services like DeepL or Google Translate.

Is there a model available that meets these requirements and can be run locally without the need for external APIs? Additionally, does this model support translating HTML source code and WordPress posts?

Python compatibility would be ideal as it’s my primary working environment.

Thanks in advance for any help and guidance.

Best regards,
BaGRoS

2

Facebook research released a paper called “No Language Left Behind,” which open sources some machine translation models. Most of the models range from 600M to 3.3B parameters, which you might be able to be run locally. I doubt they can translate HTML source code and WordPress posts, but they should do well for natural languages.
Paper link:

Models repo: