Ask for help with prediction results of Named Entity Recognition Task

🤗Transformers
2

Hello Iacle.
I suspect your issue is around WordPiece Tokenization but I can’t tell for sure with the info you posted.
Take a look at
Fine-tuning with custom datasets — transformers 4.5.0.dev0 documentation
In particular pay attention to when it talks about WordPiece Tokenization and the code in
def encode_tags(tags, encodings): …

1 Like