Shouldn’t this work? dataset = load_dataset('json', data_files='path/to/file') dataset.train_test_split(test_size=0.15) I’m getting this following error: Using custom data configuration default Downloading and preparing dataset json/default-cf892ee5bc3fc36a (download: Unknown size, generated: Un…

AttributeError: 'DatasetDict' object has no attribute 'train_test_split'

muhfaizan August 5, 2023, 7:06am 5

This worked for my case. Thanks

dataset = load_dataset('csv', split='train', data_files='train.csv')

2 Likes

Topic		Replies	Views
How to split main dataset into train, dev, test as DatasetDict 🤗Datasets	21	43090	May 23, 2024
How to split Hugging Face dataset to train and test? 🤗Datasets	5	55564	January 24, 2023
Custom Local Data Loading: generating split with load_dataset() not working: Values in `DatasetDict` should be of type `Dataset` but got type '<class 'datasets.dataset_dict.DatasetDict' 🤗Datasets	2	575	June 13, 2023
Load_dataset assumes 'train' Beginners	2	950	May 31, 2023
Train_test_split with a dataset loaded from dict Beginners	1	651	November 9, 2022