Hi :wave: Trying to deploy mistralai/Mistral-7B-Instruct-v0.1 model on AWS Sagemaker using the Hugging Face LLM DLC. Here is my code: import json from sagemaker.huggingface import HuggingFaceModel from sagemaker.huggingface import get_huggingface_llm_image_uri # retrieve the llm image uri llm_ima…

Mistral AI Sagemaker deployment failing

philschmid October 4, 2023, 1:52pm 2

Mistral is not supported in 1.0.3 since the model came afterwards, please try 1.1.0

2 Likes