Do I have to use the dataset library to be able to fine-tune gpt2? if yes, should I add the special tokens to the file before passing it to the tokenizer?
1 Like
Do I have to use the dataset library to be able to fine-tune gpt2? if yes, should I add the special tokens to the file before passing it to the tokenizer?