Hi,
I try this code in a server with internet connection:
from datasets import load_dataset
wiki = load_dataset("wikipedia", "20200501.en", split="train")
Then automatic downloading process began and there is a folder
~/.cache/huggingface/datasets/wikipedia/20200501.en/1.0.0/4021357e28509391eab2f8300d9b689e7e8f3a877ebb3d354b01577d497ebc63/
which contains wikipedia-train.arrow
and some other files.
Now I’d like to use the dataset in a server without internet connection.
What should I do?
I tried it with
from datasets import load_from_disk
wiki = load_from_disk("~/.cache/huggingface/datasets/wikipedia/20200501.en/1.0.0/4021357e28509391eab2f8300d9b689e7e8f3a877ebb3d354b01577d497ebc63"
It showed state.json
not found in that folder.
Any advice?