How do we quantize facebook / mbart-large-50-one-to-many-mmt to ONNX runtime

[Vimal0703]

I want to know where to find the mbart-large-50-one-to-many-mmt model so that I can download and convert to onnx model and please do suggest a way to convert this model to onnx runtime.

[rgwatwormhill]

Have you seen these:

Models - Hugging Face

Export 🤗 Transformers Models

https://github.com/huggingface/transformers/blob/master/notebooks/04-onnx-export.ipynb

[addressoic]

I wasn’t able to convert with the above scripts, were you able to do any type of conversion of this model ONNX or TorchScript? If so, please share!