MTEB leaderboard page is unusable

I have visited the page MTEB Leaderboard - a Hugging Face Space by mteb again after a few months and now it’s barely usable. Yesterday it took 5 minutes to load. Today it doesn’t even show because of “runtime error”.

Could you please just leave it as it was before?

1 Like

It’s stopped at “Building…” now.:sweat_smile: It looks like the new test version is working.

1 Like

Thanks @John6666.
I’m not sure why it’s a good idea for a leaderboard webpage to depend on the execution of some PyTorch code. This kind of tasks should be run in the background without affecting the display of the front-end.

1 Like

It looks like the original page has been built.

Well, these leaderboards are web apps that work while accessing data sets rather than web pages…
It seems that mteb uses sentence_transformers, so it probably needs torch.
I think it wouldn’t be too difficult to make a simple version for viewing only, but it would be a lot of work to manage…

1 Like

Personally I think “viewing only” is what most users need (and is the purpose of most of the visits to the website). The current page is hugely overkill in my opinion (those features should be in another advanced page). The proof of why this would be better is clear: the current page is broken (and this will happen again).

1 Like

I’m not very familiar with leaderboards, but the Gradio component I happened to see the other day looks relatively robust. Combined with the SSR (server-side rendering) function of Gradio 5, it will be easier to create leaderboards that are comfortable for users to view.

1 Like