Reformer-enwik8 output does not seem to make sense

it seems to be:

model(input_ids=ids, attention_mask=masks)["logits"]

and I can get

['  t 94. aaitkl Beft tnI io rornd ahe [epartment of ']

as output
and it seems to be a correct one!