Permanently saving dataset with load_dataset

🤗Datasets
1

Hi all,

How do I permanently download the dataset via load_dataset?

When I do this:

# I load almost all glue datasets
dataset = load_dataset("glue", "mrpc")
dataset = load_dataset("glue", "mnli")
...
dataset = load_dataset("glue", "qnli")

It still redownloads some of the datasets after running the code several times. Because its saved in cache.

Is there a way to download them in a way with load_data that it stays there permanently?

2

Hi ! Unless you clear the cache, the datasets are only downloaded once.

What makes you think that the datasets are being redownloaded ?