When I use lm_eval and datasets to evaluate LLM, I met error

Beginners
1

For example, ‘load_datasets(‘piqa’)’ cause the error ‘TypeError: ‘NoneType’ object is not callable’. Actually change it to ‘gimmaru/piqa’ didn’t error, but the args has been feed in by lm_eval, and the latter only accept ‘piqa’.

1 Like
2

Possibly ongoing issue…

3

This topic was automatically closed 12 hours after the last reply. New replies are no longer allowed.