I want to deploy Qwen2-VL-2B-Instruct to a SageMaker endpoint. I know that the model needs additional requirements such as qwen-vl-utils but also needs the latest version of transformers (4.45.2) to work properly. As this version of transformers is not available in DLC, I added a requirements.txt an…

Unable to deploy Qwen2-VL model on SageMaker

John6666 October 23, 2024, 4:06pm 2

Could it be a bug in SageMaker?

Topic		Replies	Views
Deployment issue on Sagemaker Amazon SageMaker	16	3342	October 4, 2023
Error hosting endpoint when deploying model Amazon SageMaker	2	3077	March 27, 2024
Deploying TheBloke/Luna-AI-Llama2-Uncensored-GGML Amazon SageMaker	0	850	September 11, 2023
Inference failed for FLAN-UL2(20B) on SageMaker Amazon SageMaker	6	2175	April 4, 2023
Mistral AI Sagemaker deployment failing Amazon SageMaker	3	2072	December 29, 2023