I have a file in which all train/validation/test splits and corresponding data are included.
If I load the json file without the
field argument, the error information shows that
This JSON file contain the following fields: ['train', 'validation', 'test']. Select the correct one and provide it as `field='XXX'` to the dataset loading method.
But I can only use
load_dataset("json", data_files="xx.json", field="train")
to load the specific split.
When I tried to use
load_dataset("json", data_files="xx.json", field=["train", "validation", "test"])
it seems not work.
I think it’s not necessary to split data into files. Is there a better way to meet my requirements, or should I open an issue to ask for the support for a “list” field?