How to extend the download time limit

[jennyli]

When using load_dataset(), each download of the dataset will end in 10 minutes, even if the download has not yet been completed. Then go directly to the extract step, because the compressed package has not been downloaded, so the decompression fails. The data package is relatively large, and the download will definitely not be completed in 10 minutes. How can I extend the download time limit?

my code:
my_download_config = DownloadConfig(
cache_dir=‘/data/huggingface/cache’,
resume_download=True,
use_auth_token=True,
num_proc=5,
max_retries=3
)
dset = load_dataset(“facebook/pmd”, dataset, use_auth_token=True, cache_dir=‘/data/huggingface/cache’, num_proc=5, download_config=my_download_config)

result:

grateful for help

[lhoestq]

I tried on colab and it worked fine on my side (though it took less than 10min to download).

Does it fail every time at exactly 9:59 ?