Upload dataset rate limit

Hi, I tried using parallel to upload datasets, but it quickly hit the rate limit. I now switch back to upload it one by one but it still says rate limit. I also tried upgrade to pro user but it doesn’t help

cc @Wauplin for the rate-limit

also: Repository limitations and recommendations in case it helps

Rate limits are lifted after 1h so it should get back to normal soon. Depending on your dataset size, you might be interested in looking at this experimental feature that upload large datasets in an reliable way (avoiding rate limits as much as possible): [Feedback welcome] CLI to upload arbitrary huge folder by Wauplin · Pull Request #2254 · huggingface/huggingface_hub · GitHub.