Multilingual multiple languages fine-tuning on facebook mms model

Hi everyone,

I am trying to finetune facebooks mms models on some large internal data which i believe would lower the wer for these respective langauges even more.

The thing is I have over 15 diverse languages to fine-tune. but i am unsure on how to fine-tune them all on a single model.

The huggingface fine-tuning code says use an adapter for the given language and fine-tune it. should train the multiple languages sequential on per language basis ? like iterating over every lang_dataset and lang_adapter to fine-tune them all sequential ?

If someone knows any possible solution on how to go about with this please let me know :pray:

gently pinging @sanchit-gandhi