I want to deploy Qwen2-VL-2B-Instruct to a SageMaker endpoint. I know that the model needs additional requirements such as qwen-vl-utils but also needs the latest version of transformers (4.45.2) to work properly. As this version of transformers is not available in DLC, I added a requirements.txt an…

Unable to deploy Qwen2-VL model on SageMaker

John6666 October 23, 2024, 4:06pm 2

Could it be a bug in SageMaker?

Topic		Replies	Views
Unable to deploy fine tuned Mistral Amazon SageMaker	0	263	May 6, 2024
How to use Qwen2-VL on multiple gpus? 🤗Transformers	2	890	September 28, 2024
How to deploy quantized Mixtral 8x7b from Sagemaker? Amazon SageMaker	0	954	December 21, 2023
Issue in deploying quantized meta-llama/Llama-3.1-8B-Instruct in aws sagemaker Intermediate	0	60	October 10, 2024
Help for inference.py code Amazon SageMaker	10	3974	March 8, 2022