I am using this blog to deploy FLAN-UL2 on SageMaker ( Deploy FLAN-UL2 20B on Amazon SageMaker ). Everything works fine except the last 2 steps on inferencing. During inferencing (predictor.predict) it is giving me the below error: ValueError: (“You need to define one of the following [‘audio-classif…

Inference failed for FLAN-UL2(20B) on SageMaker

philschmid April 3, 2023, 6:03pm 4

@Jorgeutd could you share how you deployed the model with which versions?

Inference error for FLAN-UL2 on AWS SageMaker

Topic		Replies	Views
Inference error for FLAN-UL2 on AWS SageMaker Amazon SageMaker	1	952	April 3, 2023
ModelError when deploying google/flan-t5-xl Amazon SageMaker	1	443	July 31, 2023
ModelError when I run predict after deploying wizardcoder for text-generation Amazon SageMaker	1	876	September 25, 2023
Impossible to use flan-t5-xxl in a batch-transform job Amazon SageMaker	3	1137	May 23, 2023
HF_TASK Enviournment Variable error Amazon SageMaker	1	405	January 29, 2024