Hi. I am trying to convert a dataframe to the format for NER I have seen in example notebook. See below and example of the format
I have a dataframe which looks like:
The ner_tags is an object column
If I convert this dataframe to a datasets format by using Dataset.from_pandas(data) I get:
As you can see the format of the ‘ner_tags’ is not the same as in the NER dataset example (tokens are good). I am struggling to get this in the same format for the ner_tags. Can someone make a suggestion on this?