Hi, I am following the instructions of the tokenizer Fine-tuning a pretrained model
The example is using imdb dataset, in which there is only 1 column to be tokenized.
Therefore, how to tokenize the TimeTravel dataset? In which has 5 columns?
Related topics
| Topic | Replies | Views | Activity | |
|---|---|---|---|---|
| Cannot encode/tokenize my Dataset Dictionary | 1 | 1024 | August 19, 2021 | |
| Access word piece tokens from BERT tokenized dataset | 2 | 874 | November 17, 2021 | |
| Programmatic way to Tokenization on Custom Text Columns | 0 | 560 | June 27, 2022 | |
| [Transformer] how to tokenize nested object dataset? | 0 | 480 | November 23, 2022 | |
| Help understanding how to build a dataset for language as with the old TextDataset | 7 | 12297 | October 6, 2021 |