Inference on models with custom head

[echarlaix]

Hi @kaushu42, when loading your model with ORTModelForSequenceClassification, the original model will be loaded before conversion with AutoModelForSequenceClassification. In your case, you should first load your model and then use onnx_export_from_model to export it to ONNX