I am trying to load a data set and filter out some of the values but I’m getting this error. How do I convert the dictionaries to the type of data set?
from datasets import load_dataset
dataset = load_dataset("ArthurFischel/AA_taster_mon_hum_1_game_raw")
# Filter the dataset based on the specified conditions
filtered_dataset = dataset.filter(lambda example:example['time_stamp'] == 0)
# Print the length of the original and filtered dataset to see the difference
print("Original dataset length:", len(dataset))
print("Filtered dataset length:", len(filtered_dataset))
TypeError: Values in `DatasetDict` should be of type `Dataset` but got type '<class 'dict'>'
**fixed by using this line:
dataset['train'] = dataset['train'].filter(lambda example:example['timestamp'] != 0)