Hi all. Earlier this month I wrote a script incorporating LLAMA 3.1, and it worked well (with timeouts, etc), but for the past week whenever I try to access LLAMA 3.1 at all I get a 503 error (including for short simple requests, like HF’s sample code). Any idea what the problem may be? I do indeed…

Constant 503 error for several days when running LLAMA 3.1

John6666 April 19, 2025, 11:28am 3

There were at least three reports of the same situation on Discord, so I think it’s probably some kind of error. @michellehbn

Topic		Replies	Views
HfHubHTTPError: 503 server error Beginners	1	62	April 17, 2025
Getting "502 Server Error: Bad Gateway for url: https://api-inference.huggingface.co/models/meta-llama/Llama-3.2-3B-Instruct" error 🤗Hub	2	33	April 16, 2025
Inference API returns 504 error for Llama-3.2-3B-Instruct & google/gemma-2-2b-it Inference Endpoints on the Hub	3	15	April 21, 2025
Help using inference endpoint with Llama 3.1 405B Instruct Inference Endpoints on the Hub	1	156	August 30, 2024
Meta-llama / Meta-Llama-3-70B-Instruct is not available as a serverless API Models	10	1478	September 28, 2024