Help picking a model for semantic search

What are relevant criteria in picking a model for semantic search? I’m seeing a lot of development in LLMs but not sure how relevant those are to semantic search and document retrieval.

https://www.sbert.net/examples/applications/semantic-search/README.html

has a list of models by speed and performance you can consider.