When using load_dataset(), each download of the dataset will end in 10 minutes, even if the download has not yet been completed. Then go directly to the extract step, because the compressed package has not been downloaded, so the decompression fails. The data package is relatively large, and the download will definitely not be completed in 10 minutes. How can I extend the download time limit?
my_download_config = DownloadConfig(
dset = load_dataset(“facebook/pmd”, dataset, use_auth_token=True, cache_dir=‘/data/huggingface/cache’, num_proc=5, download_config=my_download_config)
grateful for help