Model does not exist while running chat-ui through docker

Beginners
1

Hello,

i am trying to run chat-ui via docker with mongodb
i have cloned the repository built the image and using .env file however i feel the endpoint is throwing error.

Following is my .env:

PROVIDER=hf

This is a JSON string

MODELS=[{“name”:“mistralai/Mixtral-8x7B-Instruct-v0.1”,“description”:“The latest MoE model from Mistral AI! 8x7B and outperforms Llama 2 70B in most benchmarks.”,“logoUrl”:“https://huggingface.co/datasets/huggingchat/models-logo/resolve/main/mistral-logo.png",“websiteUrl”:“https://mistral.ai/news/mixtral-of-experts/”,“modelUrl”:“https://huggingface.co/mistralai/Mixtral-8x7B-Instruct-v0.1”,“preprompt”:“”,“chatPromptTemplate”:" {{#each messages}}{{#ifUser}}[INST]{{#if @first}}{{#if @root.preprompt}}{{@root.preprompt}}\n{{/if}}{{/if}} {{content}} [/INST]{{/ifUser}}{{#ifAssistant}} {{content}} {{/ifAssistant}}{{/each}}”,“parameters”:{“temperature”:0.6,“top_p”:0.95,“repetition_penalty”:1.2,“top_k”:50,“truncate”:1024,“max_new_tokens”:1024,“stop”:[“”]},“promptExamples”:[{“title”:“Write an email from bullet list”,“prompt”:“As a restaurant owner, write a professional email to the supplier to get these products every week: \n\n- Wine (x10)\n- Eggs (x24)\n- Bread (x12)”},{“title”:“Code a snake game”,“prompt”:“Code a basic snake game in python, give explanations for each step.”},{“title”:“Assist in a task”,“prompt”:“How do I make a delicious lemon cheesecake?”}],“endpoints”:[{“type”:“tgi”,“url”:“https://api-inference.huggingface.co/models/mistralai/Mixtral-8x7B-Instruct-v0.1”}]}]

API_HEADERS={“Authorization”:“Bearer ****”,“Content-Type”:“application/json”}

Kindly help

1 Like
2

The endpoint URL seems to be outdated. Try pip install -U huggingface_hub or so in Dockerfile or somewhere else inside the Docker container.