Working on a project that needs to deploy raw HF models without training them using SageMaker Endpoints. I clone the model repo from the HF repo, tar.gz it, load it onto S3, create my SageMaker Model, endpoint configuration, and deploy my endpoint. When I send a text payload to the endpoint, I get…

Error: Could Not Load Model

dbb March 10, 2022, 11:08am 3

@dbounds , I had a call with AWS support a few minutes ago and we rebuild the whole config via the console. I created a little manual here:

maybe you can give it a try?

Best,
David

Topic		Replies	Views
Cannot invoke sagemaker endpoint, keep getting OS error Amazon SageMaker	3	1642	February 2, 2024
Getting error in the inference stage of Transformers Model (Hugging Face) 🤗Transformers	0	582	October 11, 2022
Error loading finetuned llama2 model while running inference Amazon SageMaker	27	3603	September 20, 2023
Modelerror when deploying openchat3.5 Amazon SageMaker	0	71	April 2, 2024
Error when deploying GPT4-Alpaca on Sagemaker via HF model hub Beginners	8	1107	July 11, 2023