Docker: ollama: Server unavailable, error code: 349453

mano-wii · July 29, 2024, 2:36pm

I created this space that allows me to use the ollama server endpoints:

I can call “https://mano-wii-ollama.hf.space/api/chat”

But the equivalent that is compatible with OpenAI’s API doesn’t work: “https://mano-wii-ollama.hf.space/v1/chat/completions”

It returns {"error":{'proxy_note': 'Server unavailable, error code: 349453'}}.

I saw other forums about this same error.
Locally it seems to work, but on huggingface there is this problem.

To test, you can use the code from this page:

github.com

ollama/ollama/blob/main/examples/python-simplechat/client.py

import json
import requests

# NOTE: ollama must be running for this to work, start the ollama app or run `ollama serve`
model = "llama3"  # TODO: update this for whatever model you wish to use


def chat(messages):
    r = requests.post(
        "http://0.0.0.0:11434/api/chat",
        json={"model": model, "messages": messages, "stream": True},
	stream=True
    )
    r.raise_for_status()
    output = ""

    for line in r.iter_lines():
        body = json.loads(line)
        if "error" in body:
            raise Exception(body["error"])

This file has been truncated. show original

Topic		Replies	Views
Ollama inside Space Spaces	0	139	June 13, 2024
Ollama inside Space Spaces	0	130	June 13, 2024
Run vllm docker on space Spaces	7	872	January 25, 2024
How to run "openai migrate" in hugging face space? Beginners	0	598	January 17, 2024
Spaces - Error. API, Status Code: 400 Spaces	5	2175	August 15, 2023

Docker: ollama: Server unavailable, error code: 349453

Related Topics