Can and how be created ONNX format model from generative text model?

Beginners
1

Hello friends,

I need an embeddings generating model in ONNX format for vector search. Model will be loaded into Oracle database and used in vector search feature. Is it possible and by what means to create such a model from generative text model like speakleash/Bielik-11B-v2.6-Instruct · Hugging Face and CYFRAGOVPL/PLLuM-12B-nc-instruct · Hugging Face?

Regards,
Marcin.

1 Like
2

The ONNX library itself also has a converter, but currently it is recommended to use Optimum to convert models to ONNX format.

That model looks like a normal LLM, so it should be possible to convert it using existing versions. If you are unable to convert it successfully, it is best to ask the ONNX Community.

Resources

1 Like