In a lot of cases, ONNX optimized models offer much better performance benefits as compared to using PyTorch models. This performance boost coupled with the pipelines offered by HuggingFace are a really great combo for delivering a great experience both in terms of inference speed and model perform…

Supporting ONNX optimized models

valhalla October 14, 2020, 9:48am 10

definitely possible! Copied everything so that I can have full control

Topic		Replies	Views
Transformers.onnx vs optimum.onnxruntime 🤗Optimum	1	1155	September 12, 2022
Optimize large scale transformer model inference with ONNX Runtime Models	0	381	January 18, 2022
Optimizing models using ONNX Models	1	1121	October 21, 2020
Looking for help converting transformers to ONNX with HF Optimum 🤗Transformers	0	278	November 9, 2023
:rocket: Optimum Transformers: accelerated NLP pipelines with Infinity speed 🤗Transformers	4	665	March 25, 2022