I have visited the page MTEB Leaderboard - a Hugging Face Space by mteb again after a few months and now it’s barely usable. Yesterday it took 5 minutes to load. Today it doesn’t even show because of “runtime error”.
Thanks @John6666.
I’m not sure why it’s a good idea for a leaderboard webpage to depend on the execution of some PyTorch code. This kind of tasks should be run in the background without affecting the display of the front-end.
Well, these leaderboards are web apps that work while accessing data sets rather than web pages…
It seems that mteb uses sentence_transformers, so it probably needs torch.
I think it wouldn’t be too difficult to make a simple version for viewing only, but it would be a lot of work to manage…
Personally I think “viewing only” is what most users need (and is the purpose of most of the visits to the website). The current page is hugely overkill in my opinion (those features should be in another advanced page). The proof of why this would be better is clear: the current page is broken (and this will happen again).
I’m not very familiar with leaderboards, but the Gradio component I happened to see the other day looks relatively robust. Combined with the SSR (server-side rendering) function of Gradio 5, it will be easier to create leaderboards that are comfortable for users to view.