Hi everyone,
I fixed it. There was only one line of code missing:
tokenized_datasets = tokenized_datasets.remove_columns(["text_clean", "target", "label_name"])
Just had to remove the unwanted columns from the tokenized dataset.
2 Likes