Help with DeepSeek-V3-0324 Model Download

Issue: Rate Limiting When Downloading DeepSeek-V3-0324

I’m experiencing consistent rate limiting issues when trying to download the DeepSeek-V3-0324 large model.

What I’ve tried:

  1. Git over HTTPS:
  • Direct download attempts result in “Rate limit exceeded” errors
  1. Hugging Face CLI:
  • Created and provided a token with write permissions
  • Error 429 (Too Many Requests) for the /whoami endpoint
  • Set HF_TOKEN environment variable
  1. Git over SSH:
  • Set up SSH authentication
  • Still receiving rate limit errors when pulling LFS objects
  1. Curl request:
  • Returns 429 page

Specific error messages:

batch response: Rate limit exceeded: https://huggingface.co/deepseek-ai/DeepSeek-V3-0324.git/info/lfs/objects/batch
Failed to fetch some objects from 'https://hf.co/deepseek-ai/DeepSeek-V3-0324.git/info/lfs'

git over ssh with skip(configured correctly)

GIT_LFS_SKIP_SMUDE=1 git clone git@hf.co:deepseek-ai/DeepSeek-V3-0324                                                                 
Cloning into 'DeepSeek-V3-0324'...                                                             
remote: Enumerating objects: 203, done.
remote: Counting objects: 100% (199/199), done.                                                                                                                                               
remote: Compressing objects: 100% (198/198), done.                                                                                                                                            
remote: Total 203 (delta 13), reused 0 (delta 0), pack-reused 4 (from 1)                       
Receiving objects: 100% (203/203), 2.41 MiB | 6.35 MiB/s, done.                                
Resolving deltas: 100% (13/13), done.                                                          
Downloading model-00001-of-000163.safetensors (5.2 GB)                                                                                                                                        
Error downloading object: model-00001-of-000163.safetensors (134f51f): Smudge error: Error downloading model-00001-of-000163.safetensors (134f51f4642dde3f3d63aacc8e4605e6355d27aceb4ee1a1f914e30464623f10): batch response: Rate limit exceeded: https://huggingface.co/deepseek-ai/DeepSeek-V3-0324.git/info/lfs/objects/batch   

Huggingface Cli error

Traceback (most recent call last):                                                                                                                                                            
  File "/mnt/deepseek/.venv/lib/python3.11/site-packages/huggingface_hub/utils/_http.py", line 409, in hf_raise_for_status                                                                    
    response.raise_for_status()                                                                                                                                                               
  File "/mnt/deepseek/.venv/lib/python3.11/site-packages/requests/models.py", line 1024, in raise_for_status                                                                                  
    raise HTTPError(http_error_msg, response=self)                                                                                                                                            
requests.exceptions.HTTPError: 429 Client Error: Too Many Requests for url: https://huggingface.co/api/whoami-v2                                                                              
                                                                                                                                                                                              
The above exception was the direct cause of the following exception:                                                                                                                          
                                                                                                                                                                                              
Traceback (most recent call last):                                                                                                                                                            
  File "/mnt/deepseek/.venv/lib/python3.11/site-packages/huggingface_hub/hf_api.py", line 1737, in whoami                                                                                     
    hf_raise_for_status(r)                                                                                                                                                                    
  File "/mnt/deepseek/.venv/lib/python3.11/site-packages/huggingface_hub/utils/_http.py", line 482, in hf_raise_for_status                                                                    
    raise _format(HfHubHTTPError, str(e), response) from e                                                                                                                                    
huggingface_hub.errors.HfHubHTTPError: 429 Client Error: Too Many Requests for url: https://huggingface.co/api/whoami-v2                                                                      
                                                                                                                                                                                              
The above exception was the direct cause of the following exception:                                                                                                                          
                                                                                                                                                                                              
Traceback (most recent call last):                                                                                                                                                            
  File "<stdin>", line 1, in <module>                                                                                                                                                         
  File "/mnt/deepseek/.venv/lib/python3.11/site-packages/huggingface_hub/utils/_deprecation.py", line 101, in inner_f                                                                         
    return f(*args, **kwargs)                                                                                                                                                                 
           ^^^^^^^^^^^^^^^^^^                                                                                                                                                                 
  File "/mnt/deepseek/.venv/lib/python3.11/site-packages/huggingface_hub/utils/_deprecation.py", line 31, in inner_f                                                                          
    return f(*args, **kwargs)                                                                                                                                                                 
           ^^^^^^^^^^^^^^^^^^                                                                  
  File "/mnt/deepseek/.venv/lib/python3.11/site-packages/huggingface_hub/_login.py", line 130, in login                                                                                       
    interpreter_login(new_session=new_session)                                                 
  File "/mnt/deepseek/.venv/lib/python3.11/site-packages/huggingface_hub/utils/_deprecation.py", line 101, in inner_f                                                                         
    return f(*args, **kwargs)                                                                                                                                                                 
           ^^^^^^^^^^^^^^^^^^                                                                                                                                                                 
  File "/mnt/deepseek/.venv/lib/python3.11/site-packages/huggingface_hub/utils/_deprecation.py", line 31, in inner_f
    return f(*args, **kwargs)                                                                                                                                                                 
           ^^^^^^^^^^^^^^^^^^                                                                                                                                                                 
  File "/mnt/deepseek/.venv/lib/python3.11/site-packages/huggingface_hub/_login.py", line 291, in interpreter_login                                                                           
    _login(token=token, add_to_git_credential=add_to_git_credential)                                                                                                                          
  File "/mnt/deepseek/.venv/lib/python3.11/site-packages/huggingface_hub/_login.py", line 405, in _login                                                                                      
    token_info = whoami(token)                 

Is anyone else experiencing issues with DeepSeek-V3-0324? Are there alternative download methods available?

Any assistance would be appreciated.

1 Like

There have been a lot of reports of 429 errors for about two weeks, so it’s possible that the rate limit has been raised. Also, as a method of downloading, there is the following method that uses the Python huggingface_hub library.

1 Like

Thank you @John6666

Just for testing, I’ve reattempted downloading from scratch, with SSH authentication, git ssh and extremely limited download bandwidth(about 10-20 Gigs an hour).

I particularly met the rate limiting error after I downloaded the 100th safetensor so can’t download anything over 100

This is the error

18:11:10.393098 trace git-lfs: tq: sending batch of size 1                                                                                                                             [0/775]
18:11:10.393267 trace git-lfs: ssh cache expired: git@hf.co git-lfs-authenticate deepseek-ai/DeepSeek-V3-0324 download                                                                        
18:11:10.393307 trace git-lfs: run_command: sh -c ssh -v git@hf.co 'git-lfs-authenticate deepseek-ai/DeepSeek-V3-0324 download'                                                               
18:11:10.393361 trace git-lfs: exec: sh '-c' 'ssh -v git@hf.co 'git-lfs-authenticate deepseek-ai/DeepSeek-V3-0324 download''                                                                  
18:11:10.757466 trace git-lfs: api: batch 1 files                                                                                                                                             
18:11:10.757848 trace git-lfs: HTTP: POST https://huggingface.co/deepseek-ai/DeepSeek-V3-0324.git/info/lfs/objects/batch                                                                      
> POST /deepseek-ai/DeepSeek-V3-0324.git/info/lfs/objects/batch HTTP/1.1                                                                                                                      
> Host: huggingface.co                                                                                                                                                                        
> Accept: application/vnd.git-lfs+json                                                                                                                                                        
> Authorization: Basic * * * * *                                                                                                                                                              
> Content-Length: 233                                                                                                                                                                         
> Content-Type: application/vnd.git-lfs+json; charset=utf-8                                                                                                                                   
> User-Agent: git-lfs/3.3.0 (GitHub; linux amd64; go 1.19.8)                                                                                                                                  
>                                                                                                                                                                                             
{"operation":"download","objects":[{"oid":"9976dae2a44b4407a3a39dc69104ccce67001a307b1b49e966c98ab246b371f2","size":4302317817}],"transfers":["lfs-standalone-file","basic","ssh"],"ref":{"nam
e":"refs/heads/main"},"hash_algo":"sha256"}18:11:10.883177 trace git-lfs: HTTP: 429                                                                                                           
                                                                                                                                                                                              
                                                                                                                                                                                              
< HTTP/2.0 429 Too Many Requests                                                                                                                                                              
< Content-Length: 3134                                                                                                                                                                        
< Content-Type: text/html                                                                                                                                                                     
< Date: Tue, 01 Apr 2025 18:11:10 GMT                                                                                                                                                         
< Server: CloudFront                                                                                                                                                                          
< Via: 1.1 2f51a381830e231f6bc2b46fda74f69e.cloudfront.net (CloudFront)                                                                                                                       
< X-Amz-Cf-Id: UAy76RQ23ZYFRXxVpysyAzg765cXgMIF16yeb8vec4LgJ9M_kBvgVQ==                                                                                                                       
< X-Amz-Cf-Pop: ORD56-P7                                                                                                                                                                      
< X-Cache: Error from cloudfront                                                                                                                                                              
<                                                                                                                                                                                             
18:11:10.883437 trace git-lfs: api error: Rate limit exceeded: https://huggingface.co/deepseek-ai/DeepSeek-V3-0324.git/info/lfs/objects/batch                                                 
Error downloading object: model-00101-of-000163.safetensors (9976dae): Smudge error: Error downloading model-00101-of-000163.safetensors (9976dae2a44b4407a3a39dc69104ccce67001a307b1b49e966c9
8ab246b371f2): batch response: Rate limit exceeded: https://huggingface.co/deepseek-ai/DeepSeek-V3-0324.git/info/lfs/objects/batch                                                            
                                                                                                                                                                                              
Errors logged to '/mnt/deepseek/deepseek_model/DeepSeek-V3-0324/.git/lfs/logs/20250401T181110.883602204.log'.                                                                                 
Use `git lfs logs last` to view the log.                                                                                                                                                      
error: external filter 'git-lfs filter-process' failed                                                                                                                                        
fatal: model-00101-of-000163.safetensors: smudge filter lfs failed                                                                                                                            
warning: Clone succeeded, but checkout failed.                                                                                                                                                
You can inspect what was checked out with 'git status'                                                                                                                                        
and retry with 'git restore --source=HEAD :/'           

Following your recommendation of using huggingface_hub - I get the same error, at the same endpoint for this particular file(I can download other small files)

>>> hf_hub_download(repo_id='deepseek-ai/DeepSeek-V3-0324', filename ='model-00101-of-000163.safetensors')                                                                             [4/833]
Traceback (most recent call last):                                                                                                                                                            
  File "/mnt/deepseek/.venv/lib/python3.11/site-packages/huggingface_hub/utils/_http.py", line 409, in hf_raise_for_status
    response.raise_for_status()                                                                                                                                                                 File "/mnt/deepseek/.venv/lib/python3.11/site-packages/requests/models.py", line 1024, in raise_for_status
    raise HTTPError(http_error_msg, response=self)                                                                                                                                            
requests.exceptions.HTTPError: 429 Client Error: Too Many Requests for url: https://huggingface.co/deepseek-ai/DeepSeek-V3-0324/resolve/main/model-00101-of-000163.safetensors

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/mnt/deepseek/.venv/lib/python3.11/site-packages/huggingface_hub/file_download.py", line 1484, in _get_metadata_or_catch_error
    metadata = get_hf_file_metadata(
               ^^^^^^^^^^^^^^^^^^^^^
  File "/mnt/deepseek/.venv/lib/python3.11/site-packages/huggingface_hub/utils/_validators.py", line 114, in _inner_fn
    return fn(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^
  File "/mnt/deepseek/.venv/lib/python3.11/site-packages/huggingface_hub/file_download.py", line 1401, in get_hf_file_metadata
    r = _request_wrapper(
        ^^^^^^^^^^^^^^^^^
  File "/mnt/deepseek/.venv/lib/python3.11/site-packages/huggingface_hub/file_download.py", line 285, in _request_wrapper
    response = _request_wrapper(
               ^^^^^^^^^^^^^^^^^
  File "/mnt/deepseek/.venv/lib/python3.11/site-packages/huggingface_hub/file_download.py", line 309, in _request_wrapper
    hf_raise_for_status(response)
  File "/mnt/deepseek/.venv/lib/python3.11/site-packages/huggingface_hub/utils/_http.py", line 482, in hf_raise_for_status
    raise _format(HfHubHTTPError, str(e), response) from e
huggingface_hub.errors.HfHubHTTPError: 429 Client Error: Too Many Requests for url: https://huggingface.co/deepseek-ai/DeepSeek-V3-0324/resolve/main/model-00101-of-000163.safetensors

The above exception was the direct cause of the following exception:

The bugs referred has been raised 21st November, so it seems the model at the moment is not accessible.

Inspecting the download rates - I can also notice in the download counter that the downloads in the month started to go in a rapid decline.

I didn’t find a recent post on this issue.

1 Like

Is this a bug of some kind…? @Wauplin @pierric

Just to clean up and summarize experience:

Using git downloads more than 1T data, possibly leading to IP ban,
Using a custom cloud provider - the assigned IP address might be in the range of banned addresses, resulting in 429 rejection

It seems the best approach is a targeted download of the tensorfiles with huggingface_hub cli as indicated

I can approve - this seems to work, if the rate limit has not been hit.

1 Like

Have you tried shutting off your vpn? Same happened to me then my dumb butt realized it was my vpn

1 Like