Xlm tokenizer.lang2id is None

Models
1

I was just following

to play with the model “xlm-clm-enfr-1024”. It turns out that print(tokenizer.lang2id) gives me None instead of {'en': 0, 'fr': 1}. Any comment on this?

2

I am also getting the same issue. I tried running

import torch
from transformers import XLMTokenizer, XLMWithLMHeadModel

tokenizer = XLMTokenizer.from_pretrained("xlm-clm-enfr-1024")
model = XLMWithLMHeadModel.from_pretrained("xlm-clm-enfr-1024")

language_id = tokenizer.lang2id['en']

And I am seeing NoneType error