Why I am getting so many 504 timeout error today. I am invoking Mistral-7B-Instruct-v0.3 LLM using api_key. I have a pro plan
After 5-6 API calls in between sometime its working
1 Like
This behavior may be similar to what happens when the endpoint scale setting is small.
Please help me with the
solution?
1 Like