This is a continuation of my post here . I’m trying to deploy BERT for text classification with tensorflow. When I use the model.deploy() method, I can successfully get inferences from BERT. Here’s my problem: I have four different models for classification and I want to run them on the same instance…

Model works but MultiDataModel doesn't

dan21c July 22, 2021, 12:10am 10

The container seems to be using default model directory to lookup for model instead of MME platforms model directory. We will try to reproduce this and get back.

3 Likes

Error deploying BERT on SageMaker

Topic		Replies	Views
Databricks models deployment to sagemaker are not working Amazon SageMaker	6	919	May 24, 2023
How to Create Model in SageMaker Console from .tar.gz Amazon SageMaker	7	8052	March 10, 2022
Error: Could Not Load Model Amazon SageMaker	7	5844	March 11, 2022
How do you implement Model Monitoring for Image Dataset? Amazon SageMaker	4	1272	July 11, 2022
ValueError: Could not load model /opt/ml/model with any of the following classes: (<class 'transformers.models.auto.modeling_auto.AutoModelForCausalLM'>, <class 'transformers.models.llama.modeling_llama.LlamaForCausalLM'>) Amazon SageMaker	0	102	March 13, 2024

Model works but MultiDataModel doesn't

Related Topics