I am using huggingface-cli upload-larger-folder to upload my dataset, but after some of the files are preuploaded, I meet the following warning:
"WARN","fields":{"message":"Status Code: 504. Retrying...","request_id":""},"filename":"/home/runner/work/xet-core/xet-core/cas_client/src/http_client.rs","line_number":236}
{"timestamp":"2025-09-25T04:04:07.388106Z","level":"WARN","fields":{"message":"Retry attempt #0. Sleeping 2.821052789s before the next attempt"},"filename":"/root/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/reqwest-retry-0.7.0/src/middleware.rs","line_number":171}
The command is still running but keep reporting the same warning once upon a time. What should I do?
The warning itself is just a retry notification, so it’s not a problem in itself.
However, if it occurs too frequently, it might indicate some kind of issue. One possible temporary measure is to set HF_HUB_DISABLE_XET.
And ensure pip install -U huggingface_hub[hf_xet] .
Those errors are indeed not a problem. As the retry message indicates, the thread that received the error response will retry in some amount of time. If there is an error that prevents the upload (or download) from completing successfully, an error message and stack trace will be printed. If that is the case, let me know and I can debug further.
@VLM-Forgetting how often did this error appear and what version of hf-xet do you have installed in your Python environment (you can run hf env in the terminal to see this)?