Hi, I tried using parallel to upload datasets, but it quickly hit the rate limit. I now switch back to upload it one by one but it still says rate limit. I also tried upgrade to pro user but it doesn’t help
cc @Wauplin for the rate-limit
also: Repository limitations and recommendations in case it helps
Rate limits are lifted after 1h so it should get back to normal soon. Depending on your dataset size, you might be interested in looking at this experimental feature that upload large datasets in an reliable way (avoiding rate limits as much as possible): [Feedback welcome] CLI to upload arbitrary huge folder by Wauplin · Pull Request #2254 · huggingface/huggingface_hub · GitHub.