Hey @rpelissier thanks for reporting! We’ve just pushed the changes to fix that and handle the 2_Dense/ modules when available on the Hub, it’s still a work in progress at Add `Dense`, `DenseLayer` and `DenseConfig` to handle `2_Dense/` by alvarobartt · Pull Request #660 · huggingface/text-embeddings-inference · GitHub but we hope to release it soon, so stay tuned and we’ll ping you back 
Also thanks a lot @erikkaum for handling, @tomaarsen for the assistance while solving it and @Narsil for the PR review!