I have the same problem with different models as well (including mistralai/Mistral-7B-Instruct-v0.2 and meta-llama/Meta-Llama-3-8B)
HuggingFaceHub fails with “Error raised by inference API: Cannot override task for LLM models”
This error started now, do you have any idea what it could be?