On a page of the Transformers documentation here they mention that
Some models, like
XLNetModeluse an additional token represented by a
when referring to token_type_ids model input.
I looked on XLNetModel’s documentation and AFAIK it seems to only support 2 types.
Are there any models that support 2+ types of token?