Hi Everyone, I have tried to create hugging face endpoint deployed on AWS Nvidia 4GPU, 64 GB. However initiation got failed stating the below error File "/usr/local/lib/python3.10/dist-packages/transformers/pipelines/base.py", line 1271, in check_task raise KeyError( KeyError: "Unknown task cust…

HuggingFace Endpoint Error on AWS

mahmutc August 26, 2024, 9:25am 2

hi @Nithish-2001
I don’t know how you try to deploy it but if you use ui.endpoints.huggingface.co, you might select another task from “Advanced configuration” instead of custom.

Topic		Replies	Views
Image-To-Text task on Inference Endpoint Inference Endpoints on the Hub	13	2351	October 17, 2023
HF Inference Endpoints don't finish Initializing Inference Endpoints on the Hub	0	242	March 28, 2024
Key Error when trying to deploy inference endpoint Inference Endpoints on the Hub	2	793	December 3, 2023
Model works in inference UI, but not on inference API Inference Endpoints on the Hub	0	564	August 9, 2023
Calling Sagemaker Endpoint for fine-tuned summarization model Amazon SageMaker	15	5086	March 22, 2024

HuggingFace Endpoint Error on AWS

Related topics