Why is there no pooler representation for XLNet or a consistent use of sequence_summary()?

[facehugger2020]

Thanks. I’m trying to plug in other encoders like XLNet and Roberta, so I don’t think I can necessarily rely on creating a mask with input_tokens_ids == tokenizer.pad_token_id. I’ll figure it out.