Hi, I just watched the video of the Workshop: Going Production: Deploying, Scaling & Monitoring Hugging Face Transformer models (11/02/2021) from Hugging Face. With the informations about how to deploy ( timeline start: 28:14 ), I created a notebook instance (type: ml.m5.xlarge) on AWS SageMaker whe…

How to deploy a T5 model to AWS SageMaker for fast inference?

GenV February 28, 2022, 2:38pm 13

Hi @pierreguillou, I have the same problem. I created a post here. Did you solve the problem?

Topic		Replies	Views
How to speed up Blenderbot inference with Sagemaker? 🤗Transformers	0	412	February 7, 2023
Slow inference using most recent docker image Amazon SageMaker	10	3168	March 21, 2022
Deploying Sentence Transformer as sagemaker endpoint Amazon SageMaker	18	7990	March 26, 2024
SageMaker Inference for Model Tuned Elsewhere Amazon SageMaker	4	1062	September 2, 2021
Deploying Mixtral8x7B on AWS Sagemaker from S3 Amazon SageMaker	2	451	June 11, 2024