Is it possible to remove all other language from NLLB200 except English and German?

🤗Transformers
1

Greetings Everyone,

I am starting to learn Deep Learning (especially Machine Translation). Recently I found that Facebook released pre-trained models like M2M100 and NLLB200. In HuggingFace

But I have a few questions about these models; as you all know, NLLB200 can translate more than 200x200 = 40,000 directions because they’re designed for multilingual purposes. That’s why the size of these pre-trained models is vast, but my question arrived here.

“Is it possible to delete or split this pre-trained model into only two languages?”

What I am saying is Those models will delete or split all other languages and directions, Except English and German, so it will only translate English – German and German – English.

(I mean I need only 2 Direction, not 40,000 directions)

By doing this, the model will shrink to a smaller size, which is what I need.

Your expert advice and support will be invaluable to me, and I eagerly await your reply.

2

I’m also interested in doing this with about 16 languages. 256 directions. I would image it would take tracing out what embeddings these language keys are using and extracting only those out. I would have to look look at the model graph and try to determine if thats done in specific layers or what parts could be prunned and what would have to remain to make the model smaller.