How to align sub words to words in Sentencepiece like Albert for NER?

s4sarath August 12, 2021, 4:19pm 1

Hi @sgugger @lysandre , how to align subwords back to words in task like Token Classification NER etc .

Topic		Replies	Views
Finetuning ALBERT with custom unlabeled dataset for next sentence prediction task Beginners	0	279	September 2, 2020
Identifying sections of a text document Models	1	703	November 22, 2021
Sentence reordering Models	0	448	December 27, 2020
Multilingual token, phrase and sentence representations for text similarity Research	0	417	January 13, 2021
Grouping Similar words specific to my domain Research	0	207	August 22, 2023