Convert a list of dictionaries to hugging face dataset object

🤗Datasets
1

I have a list of dictionaries. for example
data =[{'col1:‘foo1’,col2’:‘bar1’}, {‘col1:'foo2',col2':'bar2'},...,{'col1:‘foon’,col2’:‘barn’}]’
how can I convert this array into a huggingface dataset object?

1 Like
2

I think the easiest way would be datasets.Dataset.from_pandas(pd.DataFrame(data=data)).

6 Likes
3

Thank you very much @beneyal ! It worked! :smiley: :heart_eyes:

2 Likes
4 
from datasets import Dataset
my_dict = {"a": [1, 2, 3]}
dataset = Dataset.from_dict(my_dict)
2 Likes
5

If your dataset is a list of dicts, then Dataset.from_list() is made for this:

from datasets import Dataset

data = [{'col1':'foo1','col2':'bar1'}, {'col1':'foo2','col2':'bar2'},...,{'col1':'foon','col2':'barn'}]
dataset = Dataset.from_list(data)
1 Like