HTTP 504: Gateway timeout error when pushing dataset

[John6666]

Possibly .push_to_hub() issue? @lhoestq

504 Gateway Time-out when uploading large dataset to enterprise organization

Hi We recently bought an enterprise subscription in order to increase our data usage limits. However, it is no longer possible for me to push large datasets to the hub (500+ GB), as it eventually crashes with a “504 Server Error: Gateway Time-out for url: https://huggingface.co/api/datasets/{organization}/{dataset}/preupload/main” I don’t know if this have anything to do with your recent change in data usage limits policy. I see that you write that you have to contact you in order to upload d…