MT5 Decoding in wrong language

I am working on a question answering task on the mt5 transformer. After training for 50 epochs, the output is decoding into some weird language. Is there any way to force the language while encoding and decoding?