I fine-tuned BERT for text-classification on a custom dataset using HuggingFace and Tensorflow, and now I’m trying to deploy the model for inference through SageMaker. I followed this HuggingFace tutorial but I get the following error. I spent a while looking through the SageMaker HuggingFace docume…

Error deploying BERT on SageMaker

wsunadawong July 16, 2021, 3:23pm 2

Resolved: I just needed to add an image_uri!

Topic		Replies	Views
Use my finetuned Bert Model in SageMaker BatchTransform Amazon SageMaker	4	2980	April 30, 2022
InternalServerException when running a model loaded on S3 Amazon SageMaker	4	985	August 6, 2021
Inference failed for FLAN-UL2(20B) on SageMaker Amazon SageMaker	6	2167	April 4, 2023
Error loading finetuned llama2 model while running inference Amazon SageMaker	27	4812	September 20, 2023
InternalServerException from bart model created from s3 Amazon SageMaker	1	391	May 22, 2023