Some models accept
token_type_ids and others do not.
TFDistilBertForSequenceClassification does not. But, the
call method used to accept a
**kwargs parameter. This allowed users to always supply
token_type_ids to any model and if the model did not need it it would just be ignored.
Since 4.18.0, the
**kwargs argument seems to have been removed. This means we have to keep track of which models accept the
token_type_ids argument and ensure that
token_type_ids is not sent to the
call method if it is a model like DistilBert, correct? To me it seems like having the
**kwargs argument was a good thing, so I was wondering if there was something obvious I was missing.