Lots of models have rust weights available for them in the file rust_model.ot
and there’s even a rust
tag on the hub. Is there any rust project coming up from HF ? Also is there any we way I can use these weights to do inference from rust ?
cc. @julien-c
2 Likes
I see on Twitter that you figured it out, but those weights are for https://github.com/guillaume-be/rust-bert which is a great project – I think the author is planning to communicate about it in a couple of weeks
1 Like
Yes. @stefan-it shared it with me. And really seems like a great project.
Is there any way to convert bin to .ot ?
See the script here: rust-bert/convert_model.py at master · guillaume-be/rust-bert · GitHub
Note that you must install both pytorch in python and rust-bert in rust. 