ClassLabels when using push_to_hub

dvilasuero · December 29, 2021, 4:44pm

Sorry I’ve seen this has already been tackled here:

github.com/huggingface/datasets

Push dataset infos.json to Hub

huggingface:master ← huggingface:push-dataset_infos.json-to-hub

opened 02:07PM - 21 Dec 21 UTC

lhoestq

+206 -39

When doing `push_to_hub`, the feature types are lost (see issue https://github.c…om/huggingface/datasets/issues/3394). This PR fixes this by also pushing a `dataset_infos.json` file to the Hub, that stores the feature types. Other minor changes: - renamed the `___` separator to `--`, since `--` is now disallowed in a name in the back-end. I tested this feature with datasets like conll2003 that has feature types like `ClassLabel` that were previously lost. Close https://github.com/huggingface/datasets/issues/3394 I would like to include this in today's release (though not mandatory), so feel free to comment/suggest changes

Topic		Replies	Views
Changing ClassLabels for NER Beginners	3	539	November 13, 2023
Problem in pushing dataset to the Hub 🤗Datasets	3	687	November 9, 2023
Problem pushing dataset to huggingface 🤗Datasets	11	3646	June 26, 2023
Save `DatasetDict` to HuggingFace Hub 🤗Datasets	12	7531	October 20, 2023
ClassLabel disappear after loading DatasetDict Beginners	1	174	February 5, 2024

ClassLabels when using push_to_hub

Related topics