Hello guys, I want to use Starcode and wizardcoder to experiment with. went throught the documents available on website, did not find much on how can I use these models as API call. are these models hosted? can these be used using API call? are there token limits for these models?

API usage for Starcode and wizardcoder

radames July 7, 2023, 9:21pm 2

hi @sagarsdesai
the easiest way to have your own API is to setup an Inference Endpoint

Please check this blog

Topic		Replies	Views
Science and education and everything Models	1	139	December 1, 2023
StarCoderBase results in HuggingChat vs API 🤗Hub	0	370	May 8, 2023
Use custom code in model card inference API widget 🤗Hub	0	21	August 2, 2024
502 Error AI Assistant chat Beginners	1	128	June 12, 2024
Inference API (serverless) Beginners	0	122	May 29, 2024