HTTP Error 429 while running MMLU

Hi there. I’m trying to use the MMLU benchmark available at cais/mmlu · Datasets at Hugging Face . I have been trying to use it but running into HTTP Error 429 thrown while requesting HEAD ``https://huggingface.co/datasets/cais/mmlu/resolve/main/README.md. What could be the reason?

1 Like

When error 429 occurs, it may be caused by IPv6, an outdated implementation of the old datasets library, or other factors.

If it is truly an intentional rate limit, I believe only Hugging Face can resolve it…

1 Like

@John6666 thank you so much! using huggingface-cli login with my access token fixed this.

1 Like

This topic was automatically closed 12 hours after the last reply. New replies are no longer allowed.