Deploying Open AI's whisper on Sagemaker

Yerdaulet-Zh April 12, 2024, 10:13pm 58

I can not provide the configuration setting of the whisper-largev3 model while deploying.
I want to specify batch size, language, etc

Topic		Replies	Views
Transformers 4.9.0 on SageMaker Amazon SageMaker	12	1975	March 25, 2022
Inference failed for FLAN-UL2(20B) on SageMaker Amazon SageMaker	6	2170	April 4, 2023
Fix sample code to deploy and inference tasks using audio/image files Amazon SageMaker	2	920	November 21, 2022
How are the inputs tokenized when model deployment? Amazon SageMaker	13	4282	September 3, 2021
How to deploy Whisper for other languages to Sagemaker? Amazon SageMaker	0	308	February 5, 2024