I tried to deploy the model on EC2 and I got the error below.
Hi,
One should not use the TFAutoModelForCausalLM
class for loading LLaVa, one should use the AutoModelForVision2Seq
class (or equivalently, the LlavaForConditionalGeneration
class) instead.
Could you try that?