Having trouble with Inference Endpoints. Not a coding issue, but just general setup, finding models, where to enable or activate cc billing, etc…
I’ve yet to be able to get one to work. Is there any place to just get a simple complete list of the ones that are available with inference endpoints? I’m unable to really run any LLMs locally and be productive . Do they offer uncensored models also?
Any github projects that provide starter guide in markdown and sample code? and list of models?
1 Like
Hi @mjlefevre thanks for posting! Getting started with Inference Endpoints is easy - you’ll just need to add a payment method to your account and then you’re all set to start deploying at https://endpoints.huggingface.co. You can do that in your billing settings here: Hugging Face – The AI community building the future..
You can use this filtered search for models that are available with Inference Endpoints. Or you may be interested in our catalog of models that are ready to deploy and require no additional customization - and deployment is verified by Hugging Face
Check out the Model Catalog here: Inference Catalog | Inference Endpoints by Hugging Face.
I’ll also add some documentation for creating your first Endpoint just in case: Create an Endpoint.
We’re all ears to feedback, so please do not hesitate to share your experience with Inference Endpoints! Or let us know if you have other questions.
1 Like