Working on a project that needs to deploy raw HF models without training them using SageMaker Endpoints. I clone the model repo from the HF repo, tar.gz it, load it onto S3, create my SageMaker Model, endpoint configuration, and deploy my endpoint. When I send a text payload to the endpoint, I get…

Error: Could Not Load Model

anwarika March 11, 2022, 1:50pm 6

I’ve run into an issue like this before, how’d you tar your file? Are you using a Mac?

Topic		Replies	Views
Cannot invoke sagemaker endpoint, keep getting OS error Amazon SageMaker	3	2142	February 2, 2024
Getting error in the inference stage of Transformers Model (Hugging Face) 🤗Transformers	0	713	October 11, 2022
Modelerror when deploying openchat3.5 Amazon SageMaker	0	205	April 2, 2024
HF Model Deployment Trust Remote Code Amazon SageMaker	0	456	April 24, 2024
Error when deploying GPT4-Alpaca on Sagemaker via HF model hub Beginners	8	1266	July 11, 2023