On a page of the Transformers documentation here they mention that
Some models, like
XLNetModel
use an additional token represented by a2
.
when referring to token_type_ids model input.
I looked on XLNetModel’s documentation and AFAIK it seems to only support 2 types.
Are there any models that support 2+ types of token?
Cheers,
Cyrus