This is a continuation of my post here . I’m trying to deploy BERT for text classification with tensorflow. When I use the model.deploy() method, I can successfully get inferences from BERT. Here’s my problem: I have four different models for classification and I want to run them on the same instance…

Model works but MultiDataModel doesn't

dan21c July 22, 2021, 12:10am 10

The container seems to be using default model directory to lookup for model instead of MME platforms model directory. We will try to reproduce this and get back.

3 Likes

Error deploying BERT on SageMaker

Topic		Replies	Views
Error deploying BERT on SageMaker Amazon SageMaker	17	5153	November 22, 2021
Multi-Model Endpoint with Hugging Face Amazon SageMaker	6	2323	March 3, 2024
Inference Toolkit - custom inference with multiple models Amazon SageMaker	1	598	April 4, 2024
Databricks models deployment to sagemaker are not working Amazon SageMaker	6	1100	May 24, 2023
Training model file too large and fail to deploy Amazon SageMaker	3	1371	July 3, 2023

Model works but MultiDataModel doesn't

Related topics