Hi, I have been looking through one of the part 2 course tutorials for Inside the Token classification pipeline (PyTorch) illustrated by @sgugger . I have tried to use the example in (https://colab.research.google.com/github/huggingface/notebooks/blob/master/course/videos/token_pipeline_pt.ipynb) an…

Hey @ghadeermobasher there are several strategies that you can use to merge the entities and my suggestion would be to inspect the implementation in the token-classification pipeline . As you can see in the docstring there are quite some subtleties associated with merging entities correctly (depends …

Inside the Token classification pipeline (PyTorch)

Course

ghadeermobasher January 18, 2022, 10:54am 7

Yes, same for me. In the end, we need to merge the B- and I- labels entities. @sgugger any clue?

Topic		Replies	Views
Transform Logits to probabilities doesn't work Beginners	4	9406	February 17, 2022
How to get probabilities per label in finetuning classification task? Beginners	5	5465	February 18, 2022
Decoding the predicted output array in distilbertbase uncased model for NER 🤗Transformers	1	7379	October 11, 2021
Looking for tool class to do predictions 🤗Transformers	3	553	October 9, 2020
Inconsistency in Model Output [ Token Classification] 🤗Transformers	0	334	April 12, 2023

Inside the Token classification pipeline (PyTorch)

Related topics