Hi team, how to deploy multiple hugging face models for inference on a single aws sagemaker endpoint? Actually I have a AWS lambda from which I’m invoking the endpoints, I’ve 3 endpoints but I want them into single AWS endpoint to save my AWS billing amount, I’m finding article but did not find an…

Sagemaker multimodel endpoint

crajah February 2, 2023, 9:42am 2

Topic		Replies	Views
Aws sagemaker multimodel endpoint Amazon SageMaker	1	928	February 2, 2023
When to use SageMaker multi model endpoint Amazon SageMaker	3	2583	November 16, 2022
Multi-Model Endpoint with Hugging Face Amazon SageMaker	6	2368	March 3, 2024
How to deploy Sagemaker Multi-model Endpoints on GPU? Amazon SageMaker	0	375	December 14, 2023
How to quickly change the inferece.py for an endpoint on AWS SagemMaker Amazon SageMaker	1	754	December 2, 2022