I have a question regarding Trainer. In fine-tuning section of chapter 3 of the NLP course, one of the inputs of the Trainer is tokenizer.
However, in the tutorial, tokenizer is not used as input.
What is the difference then? What about using DataCollator?