Hey folks, super noob here trying to deploy a model to an inference endpoint to try it out. Here’s the model I’m trying to deploy truehealth/LLaVar · Hugging Face and the endpoint hardware configuration I’m deploying on is GPU · Nvidia Tesla T4 · 4x GPU · 16 GB. I’m seeing the following error in th…

Key Error when trying to deploy inference endpoint

JeanMachado December 3, 2023, 5:39pm 3

Facing same issue, here, any way to fix it?

Topic		Replies	Views
Model works in inference UI, but not on inference API Inference Endpoints on the Hub	0	564	August 9, 2023
Inference Endpoint Deployment Error Beginners	2	41	February 7, 2025
Qwen failed to build on Huggingface Inference Endpoint Models	0	237	February 23, 2024
Unable to load nvidia canary and parakeet models Inference Endpoints on the Hub	0	149	May 5, 2024
Inference Endpoint Fails to Start Inference Endpoints on the Hub	16	3617	February 9, 2024