I’ve managed to produce an NER module following this tutorial. Although I am using the ScienceIE dataset (Process, Material, Task entities).
The issue is that my model only predicts the ‘O’ tag… I can understand that the model does it because the majority of tags are ‘O’ but obviously this isn’t solving the task.
I’ve created a custom compute_metrics function that calculates f1 score for each entity and the macro-average. However, this doesn’t help steer the model. Do I need to create a custom loss function?
I’ve tried googling around for this issue but haven’t had much luck. Sorry if this is a repeat issue.
Thanks for your help.