504 timeout error

Beginners
1

Why I am getting so many 504 timeout error today. I am invoking Mistral-7B-Instruct-v0.3 LLM using api_key. I have a pro plan
After 5-6 API calls in between sometime its working

1 Like
2

This behavior may be similar to what happens when the endpoint scale setting is small.

3

Please help me with the
solution?

1 Like