I want to deploy Qwen2-VL-2B-Instruct to a SageMaker endpoint. I know that the model needs additional requirements such as qwen-vl-utils but also needs the latest version of transformers (4.45.2) to work properly. As this version of transformers is not available in DLC, I added a requirements.txt an…

Unable to deploy Qwen2-VL model on SageMaker

John6666 October 23, 2024, 4:06pm 2

Could it be a bug in SageMaker?

Topic		Replies	Views
Unable to deploy fine tuned Mistral Amazon SageMaker	0	247	May 6, 2024
How to deploy quantized Mixtral 8x7b from Sagemaker? Amazon SageMaker	0	916	December 21, 2023
Issue in deploying quantized meta-llama/Llama-3.1-8B-Instruct in aws sagemaker Intermediate	0	13	October 10, 2024
Help for inference.py code Amazon SageMaker	10	3842	March 8, 2022
Sagemaker deployment fails for local llama2 model Amazon SageMaker	3	2060	August 17, 2023