Why can't I select my dataset in the Model Evaluator?

I’d like to test my dataset using the Model Evaluator, but it doesn’t show up as an option when I type in the name. Is this a bug, or is there some type of restriction that is preventing me from evaluating it?

It’s because requirements.txt · autoevaluate/model-evaluator at main requires a very old version of huggingface-hub that is before pagination. So it only lists the first 10000 datasets.