[urgent]Can you reconstruct datasets using the cache file (.arrow file)?

🤗Datasets
#1

Hi,

Basically I construct a dataset through the mapping function in jupyter notebook. I can find the cache file (.arrow). Is there a way I can reconstruct the dataset similar to “datasets.load_from_disk()”

Screen Shot 2021-01-02 at 2.59.22 PM
Screen Shot 2021-01-02 at 2.59.22 PM746×120 16.3 KB

1 Like
#2

Sure ! If you only have the .arrow file you can do

from datasets import Dataset 

dataset = Dataset.from_file(path_to_arrow_file)
2 Likes
#3

It works! thank you so much!