Hugging Face Forums
How to deploy a T5 model to AWS SageMaker for fast inference?
Amazon SageMaker
GenV
February 28, 2022, 2:38pm
13
Hi
@pierreguillou
, I have the same problem. I created a post
here
. Did you solve the problem?
show post in topic
Related topics
Topic
Replies
Views
Activity
How to speed up Blenderbot inference with Sagemaker?
🤗Transformers
0
412
February 7, 2023
Slow inference using most recent docker image
Amazon SageMaker
10
3161
March 21, 2022
Deploying Sentence Transformer as sagemaker endpoint
Amazon SageMaker
18
7938
March 26, 2024
SageMaker Inference for Model Tuned Elsewhere
Amazon SageMaker
4
1060
September 2, 2021
Deploying Mixtral8x7B on AWS Sagemaker from S3
Amazon SageMaker
2
440
June 11, 2024