Model selection

Models
1

Hi all,

I am a Product Manager looking at a model selection for a conversational UX. Reaching out for input from technical folks and anyone knowledgeable as to how to go about a model exploration and selection in general.

What should I consider? What is the best place to search for a model? And any further considerations?

Hugging Face hosts more than 2 million models to choose from, good documentation

I’ve been using AWS and GCP for labs and experiment apps too

GCP Model Garden

AWS Bedrock

Thank you for any suggestions you might be willing to share

1 Like
2

Ultimately, I think it’s best to actually run an LLM locally or in the cloud to get a feel for it before choosing one.

But anyway, there are a lot of models. Many people use leaderboards to narrow down their options. These are rankings sorted by benchmark scores. There are leaderboards for various themes based on benchmarks for different tasks.

Also, if you have a specific task in mind, it’s a good idea to look into well-regarded models and their derivative models on forums related to that task.

Leaderboards

1 Like
3

I generally recommend trying models on rented GPU’s first.

Leaderboards are great - but communities themselves always seem to have “favorite” models as well.

for instance:

  • image gen models

- creative writing models

  • coding models
2 Likes