Custom Dataset with Custom Tokenizer

🤗Datasets
2

You should just use the tokenizer __call__: tokenizer(example["text"]).