How to interact with my Chatbot?

Beginners
1

So, I have created a chatbot using Gardio, using chatbot Template.

It is running Zephyr, and works better than Falcon.AI
I am happy.

But, I want to access the thing via API, specifically, send questions from a JS app ! I must use vanila js. No NPM or stuff.

I click on the small button “Use with API” below the page. It opens the pop up. I go under Bash, and i see the following curl code:


curl -X POST https://vernalsystems-valkyrie-svelhana.hf.space/gradio_api/call/chat -s -H "Content-Type: application/json" -d '{
    "data": [
  "What is the Capital city of Canada?",
  "Hello!!",
  1,
  0.1,
  0.1
  ]}' \
        | awk -F'"' '{ print $4}'  \
        | read EVENT_ID; curl -N https://vernalsystems-valkyrie-svelhana.hf.space/gradio_api/call/chat/$EVENT_ID

But it is responding with a HTML file to the end of:

404

Sorry, we can’t find the page you are looking for.

Now, I change the visibility to public and try again. I only get a"EventID" back. Example:


 curl -X POST https://vernalsystems-valkyrie-svelhana.hf.space/gradio_api/call/chat -s -H "Content-Type: application/json" -d '{
    "data": [
  "What is the capital city of Canada?",
  "Hello!!",
  512,
  0.6,
  0.6
  ]}'

I get back : {"event_id":"bedd427ca76042b7b1......... etc"}

What can be done, please? Thank you.

1 Like
2

This may occur due to a discrepancy between the local Gradio version and the Spaces version.

Solved it! This happens when the app on the server is at a different gradio version than the gradio libraries on your local machine. I think, more so, between 4.x and 5.x versions. So you can either downgrade the version on either or upgrade. I upgraded on my local to latest 5.x ones and it worked.

3

LocalGradio? I am making a cURL call from Fish Shell

1 Like
4

That’s right… it’s curl, not Client…
My mistake.

5

Yes, so now i hav this:

curl -X POST https://vernalsystems-valkyrie-svelhana.hf.space/gradio_api/call/chat \
           -H "Authorization: Bearer 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" \
           -H "Content-Type: application/json" \
           -d '{
             "data": [
               "What is the capital of canada",
               "You are a friendly Chatbot."
             ]
           }'

It now only returns a event id …

1 Like
6

Perhaps this?

7

There’s a token leak. You need to invalidate it.

1 Like
8

PS I Managed to use this via Python

from gradio_client import Client

client = Client("vernalsystems/VALKYRIE-Svelhana",
                hf_token='hf_ding-dong')
result = client.predict(
                message="Hello!! What is the capital of Canada?",
                system_message="You are a friendly Chatbot.",
                max_tokens=1024,
                temperature=0.7,
                top_p=0.95,
                api_name="/chat"
)
print(result)

Now my question is: How do I do it via Javascript? Without using NPM…

I tried this:

const apiKey = "hf_ding-donh";  // Your Hugging Face API token

// Define the function to make the request
async function callGradioChat() {
    const response = await fetch("https://vernalsystems-valkyrie-svelhana.hf.space/run/chat", {
        method: "POST",
        headers: {
            "Authorization": `Bearer ${apiKey}`,  // Add the API key to the Authorization header
            "Content-Type": "application/json"
        },
        body: JSON.stringify({
            data: {
message: "Hello!! What is the Capital city of Canada?", 		
		system_message: "Hello!!", 		
		max_tokens: 1, 		
		temperature: 0.1, 		
		top_p: 0.1,
}
        })
    });

    // Parse the response as JSON
    const result = await response.json();
    console.log(result);
}

// Call the function to execute the request
callGradioChat();

But it just returns


Object: {
  "detail": "Not Found"
}

I need it to work with vanilla JS or JQuery. Thank you.

1 Like
9

Bloody …

Done! THANK YOU

1 Like