Hi team, how to deploy multiple hugging face models for inference on a single aws sagemaker endpoint? Actually I have a AWS lambda from which I’m invoking the endpoints, I’ve 3 endpoints but I want them into single AWS endpoint to save my AWS billing amount, I’m finding article but did not find an…

Sagemaker multimodel endpoint

crajah February 2, 2023, 9:42am 2

Topic		Replies	Views
Aws sagemaker multimodel endpoint Amazon SageMaker	1	944	February 2, 2023
Getting "No worker is available to serve request: model" with HuggingFaceModel endpoint Amazon SageMaker	13	5091	March 22, 2022
About the Amazon SageMaker category Amazon SageMaker	25	4104	August 5, 2021
Serverless endpoint deployment with Terraform Amazon SageMaker	3	1667	November 2, 2022
Model works but MultiDataModel doesn't Amazon SageMaker	10	1109	August 18, 2021