I have tried to deploy the Gated Model which is of 7b and 14 gb in size on ml.g5.2x large instance on sagemaker endpoint. I have the access to the model and I am using the same code available on huggingface for deployment on Amazon Sagemaker. But It results into UnexpectedStatusException and on checking the logs it was showing. It is an gated Repo. You must be authenticated to use it.
Related topics
Topic | Replies | Views | Activity | |
---|---|---|---|---|
Deployment issue on Sagemaker | 16 | 3334 | October 4, 2023 | |
Error hosting endpoint when deploying model | 2 | 3065 | March 27, 2024 | |
Gated Model access error during training on SageMaker | 1 | 791 | September 4, 2023 | |
GPT-J fails on Amazon Sagemaker | 2 | 1294 | July 21, 2022 | |
Failed. Reason: Please make sure all images included in the model for the production variant AllTraffic exist, and that the execution role used to create the model has permissions to access them | 17 | 4440 | November 27, 2023 |