I am facing an issue with load_metric.
Here a minimum code, taken from comments in here: https://github.com/huggingface/datasets/blob/main/metrics/seqeval/seqeval.py
import datasets
predictions = [[‘O’, ‘O’, ‘B-MISC’, ‘I-MISC’, ‘I-MISC’, ‘I-MISC’, ‘O’], [‘B-PER’, ‘I-PER’, ‘O’]]
references = [[‘O’, ‘O’, ‘O’, ‘B-MISC’, ‘I-MISC’, ‘I-MISC’, ‘O’], [‘B-PER’, ‘I-PER’, ‘O’]]
seqeval = datasets.load_metric(“seqeval”)
results = seqeval.compute(predictions=predictions, references=references)
print(list(results.keys()))
print(results[“overall_f1”])
print(results[“PER”][“f1”])
It raises the error:
TypeError: classification_report() got an unexpected keyword argument ‘suffix’
For context, versions on my pip list -v
datasets 1.12.1
seqeval 1.2.2