Open LLM Leaderboard - wrong number of parameters

@open-llm-leaderboard , maybe I missed something or found a bug, but it seems that recently, since about December 17th 2024, the number of parameters is not being reported correctly in Open LLM Leaderboard:

It seems that the number reported in the table is 2 times too low.

If someone from Open LLM Leaderboard read it, can you confirm or fix it?

Thanks :slight_smile:

1 Like

Try contacting author in Discussion.

Thanks for the suggestion. Done. See:

1 Like