How to get Evaluator stats per image label/class?

Hi, is there a simple way to get accuracy per each label/class in image classification? Doing task_evaluator.compute seems to return overall stats only.

Not at the moment, but @NimaBoscarino is working on a disaggregation library and that could be another use-case for it.

1 Like

Yes, that would be a use-case! Keep an eye on this library (GitHub - huggingface/disaggregators) for more info about that in the next little while.

1 Like