I am trying to push a large dataset with help of dataset.push_to_hub() While pushing, it gives HTTP error :504 requests.exceptions.HTTPError: 504 Server Error: Gateway Time-out for url: https://huggingface.co/api/datasets/name/repo-name/upload/main/data/train2-00041-of-00064.parquet How to avoid…

HTTP 504: Gateway timeout error when pushing dataset

davidhhmack March 3, 2025, 6:27pm 9

Thanks, I appreciate it! It’s crushing to get hours through an upload, then have it die

2 Likes