I would like to use a custom metric, probably mean squared error. It is in sklearn.metrics but not in datasets.metrics – what is the quickest way to do this if it is not available in datasets.metrics?

How to write my own metrics if it is not in datasets.metrics

lhoestq October 12, 2022, 11:05am 4

metrics are now deprecated in datasets - please check the evaluate library from now on !

Topic		Replies	Views
Using a custom metric on the Huggingface Hub 🤗Datasets	1	1540	June 3, 2022
Can't import load_metric from datasets 🤗Datasets	4	15929	February 22, 2025
Unable to import load_metric Beginners	2	995	October 6, 2024
Datasets - metrics Beginners	0	399	January 30, 2021
Evaluation metrics 🤗Transformers	1	2010	November 16, 2020