My office PC doesn’t have access to internet, and the load_metric function downloads the metric from internet. I tried pickling using the following code: PC 1 (connected to internet) import pickle from datasets import load_metric metric = load_metric("glue", "mrpc") with open('metric.pickle', 'wb'…

Using "load_metric" offline in datasets

lhoestq August 23, 2021, 4:04pm 2

Hi ! Yes you just need to have the metric python file from datasets/metrics at master · huggingface/datasets · GitHub and load it with

load_metric("path/to/metric.py")

1 Like

Topic		Replies	Views
Unable to import load_metric Beginners	2	1019	October 6, 2024
Using a custom metric on the Huggingface Hub 🤗Datasets	1	1541	June 3, 2022
Can't import load_metric from datasets 🤗Datasets	4	16261	February 22, 2025
When calling load_metric ('rouge') what file is downloaded (and where do I find it)? 🤗Datasets	1	1888	April 22, 2022
Save and load datasets 🤗Datasets	2	39930	August 16, 2021