Which is the best way to quantize a sentence transformer model in your opinion. I am referring to multilingual bert-based models.
Related topics
| Topic | Replies | Views | Activity | |
|---|---|---|---|---|
| Multilang bert vs translating to english | 0 | 607 | May 28, 2022 | |
| Choosing between monolingual and multilingual models | 0 | 204 | May 23, 2024 | |
| Which model of transformers to use if I want to do multiclassification of a pair of sentences containing a questionair | 0 | 251 | February 18, 2022 | |
| Use sentence transformers with different embeddings size | 0 | 288 | June 6, 2023 | |
| CPU based Bert question answering model | 0 | 392 | November 18, 2021 |