Deploying LLaVA model on amazon EC2

Beginners
1

I tried to deploy the model on EC2 and I got the error below.

image
image1418Ă—93 5.35 KB

2

Hi,

One should not use the TFAutoModelForCausalLM class for loading LLaVa, one should use the AutoModelForVision2Seq class (or equivalently, the LlavaForConditionalGeneration class) instead.

Could you try that?