Error deploying endpoint on Aws

mahmutc · August 23, 2024, 9:12am

hi @Knour13
Did you check CloudWatch logs?

github.com/aws/amazon-sagemaker-examples

Failed Reason: The primary container for production variant AllTraffic did not pass the ping health check.

opened 04:26PM - 08 Mar 18 UTC

closed 09:46PM - 19 Mar 18 UTC

I am trying to deploy a BYOB (bring your own model) keras model. I pushed the im…age to ECR with the 'latest' tag. All local testing passed, and I am able to successfully train the model e.g.: ```python image = '{}.dkr.ecr.{}.amazonaws.com/my-model:latest'.format(account, region) dl = sage.estimator.Estimator(image, role, 1, 'ml.c4.2xlarge', output_path="s3://{}/output".format(sess.default_bucket()), sagemaker_session=sess) ``` However attempting to deploy gives me the error: ``` Failed Reason: The primary container for production variant AllTraffic did not pass the ping health check. ``` I am not quite sure where this stems from given local health check passed. Any insight would be great! Thanks.

Topic		Replies	Views
Error hosting endpoint when deploying model in sagemaker Models	0	90	July 20, 2024
Error hosting endpoint when deploying model Amazon SageMaker	2	3051	March 27, 2024
Deploying TheBloke/Luna-AI-Llama2-Uncensored-GGML Amazon SageMaker	0	844	September 11, 2023
Need help deploying a HF model to AWS Sagemaker Amazon SageMaker	3	165	September 27, 2024
Error loading finetuned llama2 model while running inference Amazon SageMaker	27	4809	September 20, 2023

Error deploying endpoint on Aws

Related topics