How to get around rate limits?

Beginners
7

This failed shortly after it started with the ‘upload’ option.

File “/Users/user/miniforge3/lib/python3.12/site-packages/huggingface_hub/utils/_http.py”, line 409, in hf_raise_for_status
response.raise_for_status()
File “/Users/user/miniforge3/lib/python3.12/site-packages/requests/models.py”, line 1024, in raise_for_status
raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 504 Server Error: Gateway Time-out for url: https://huggingface.co/api/datasets/mysocratesnote/jfk-files-text/commit/main

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
File “/Users/user/miniforge3/bin/huggingface-cli”, line 8, in
sys.exit(main())
^^^^^^
File “/Users/user/miniforge3/lib/python3.12/site-packages/huggingface_hub/commands/huggingface_cli.py”, line 57, in main
service.run()
File “/Users/user/miniforge3/lib/python3.12/site-packages/huggingface_hub/commands/upload.py”, line 206, in run
print(self._upload())
^^^^^^^^^^^^^^
File “/Users/user/miniforge3/lib/python3.12/site-packages/huggingface_hub/commands/upload.py”, line 301, in _upload
return self.api.upload_folder(
^^^^^^^^^^^^^^^^^^^^^^^
File “/Users/user/miniforge3/lib/python3.12/site-packages/huggingface_hub/utils/_validators.py”, line 114, in _inner_fn
return fn(*args, **kwargs)
^^^^^^^^^^^^^^^^^^^
File “/Users/user/miniforge3/lib/python3.12/site-packages/huggingface_hub/hf_api.py”, line 1624, in _inner
return fn(self, *args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^
File “/Users/user/miniforge3/lib/python3.12/site-packages/huggingface_hub/hf_api.py”, line 4934, in upload_folder
commit_info = self.create_commit(
^^^^^^^^^^^^^^^^^^^
File “/Users/user/miniforge3/lib/python3.12/site-packages/huggingface_hub/utils/_validators.py”, line 114, in _inner_fn
return fn(*args, **kwargs)
^^^^^^^^^^^^^^^^^^^
File “/Users/user/miniforge3/lib/python3.12/site-packages/huggingface_hub/hf_api.py”, line 1624, in _inner
return fn(self, *args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^
File “/Users/user/miniforge3/lib/python3.12/site-packages/huggingface_hub/hf_api.py”, line 4285, in create_commit
hf_raise_for_status(commit_resp, endpoint_name=“commit”)
File “/Users/user/miniforge3/lib/python3.12/site-packages/huggingface_hub/utils/_http.py”, line 482, in hf_raise_for_status
raise _format(HfHubHTTPError, str(e), response) from e
huggingface_hub.errors.HfHubHTTPError: 504 Server Error: Gateway Time-out for url: https://huggingface.co/api/datasets/mysocratesnote/jfk-files-text/commit/main

1 Like