Gemma-2b metrics are not equal to the reported

Models
1

The reported metrics for gemma-2b cannot be reproduced using the lm-eval package.
Any ideas why this may be?