How to download selected files from the “LEAP/ClimSim_high-res” dataset without downloading the whole dataset?
from datasets import load_dataset
data_files = {"train": "train.csv", "test": "test.csv"}
dataset = load_dataset("namespace/your_dataset_name", data_files=data_files)
hope this helps
Hi! load_dataset("LEAP/ClimSim_high-res", data_files=list_of_data_files_to_load) doesn’t work because nc is not a format supported by datasets, which means it’s best to download a subset of files manually and process them before building a dataset. Also, feel free to create a discussion in the repo to request adding a dataset script (to load a dataset or its subset) from the authors.