While using trainer class to finetune gpt-2 on Hindi dataset. It’s outputting the following error
While using trainer class to finetune gpt-2 on Hindi dataset. It’s outputting the following error
TypeError Traceback (most recent call last)
<ipython-input-44-3435b262f1ae> in <module>()
----> 1 trainer.train()
5 frames
/usr/local/lib/python3.6/dist-packages/transformers/data/datasets/language_modeling.py in __getitem__(self, i)
99
100 def __getitem__(self, i) -> torch.Tensor:
--> 101 return torch.tensor(self.examples[i], dtype=torch.long)
102
103
TypeError: an integer is required (got type NoneType)
Here is the link: https://colab.research.google.com/drive/1um5UeY9hasmjPNcR1WkBe2uDDFhLUBrX?usp=sharing