Model huggingfaceh4/zephyr-7b-alpha is not supported for task text-generation

Models
1

Hi everyone,

I’m trying to use the model “huggingfaceh4/zephyr-7b-alpha” through the “HuggingFaceEndpoint” integration in LangChain for PDF files reader and chatbot application. However, I’m running into this error:
Model huggingfaceh4/zephyr-7b-alpha is not supported for task text-generation and provider featherless-ai. Supported task: conversational.

Has anyone encountered this issue or knows the correct configuration (task, method, etc.) to use this model for general text generation with LangChain or Hugging Face’s Inference API?

The current model assign is: llm = HuggingFaceEndpoint(repo_id=“huggingfaceh4/zephyr-7b-alpha”)

Thanks in advance!

1 Like
2

It seems to be a known issue, and there is currently no workaround with LangChain.js…