I am tokenizing a news article using DistilBERT tokenizer whose max token length supposed to be 512, but I a getting 280,
I dont know what is the issue, I have worked with DistilBERT before and it used to give 512 as the max length…