Hi there, I am trying to deploy a model loaded on S3, following the steps found mainly on this video: [Deploy a Hugging Face Transformers Model from S3 to Amazon SageMaker](https://www.youtube.com/watch?v=pfBGgSGnYLs). For that I have downloaded a model into a S3 bucket and use this image URI for …

InternalServerException when running a model loaded on S3

philschmid August 6, 2021, 7:53am 4

You don’t need to provide an image_uri the HuggingFaceModel will select the right one based on pytorch_version and transformers_version.

Topic		Replies	Views
Error deploying BERT on SageMaker Amazon SageMaker	20	5356	April 1, 2025
InternalServerException from bart model created from s3 Amazon SageMaker	1	403	May 22, 2023
Deploying TheBloke/Luna-AI-Llama2-Uncensored-GGML Amazon SageMaker	0	863	September 11, 2023
Getting error in the inference stage of Transformers Model (Hugging Face) 🤗Transformers	0	790	October 11, 2022
Save and deploy distilbert model in AWS SageMaker 🤗Transformers	2	2650	April 9, 2021