Hello,
1., this line does not work from the documentation:
print(’, '.join(dataset.id for dataset in datasets_list))
AttributeError: ‘str’ object has no attribute ‘id’
2., I would like to use the metrics provided on huggingface (csv file of GPT-2 generated sentences on reddit data)
I could load the generated sentences into dataset, and got:
features: [‘real_id’, ‘fake_reply’, ‘is_fake’],
num_rows: 73799
If I try to run the bleurt metrics, what else do I need to specify?
do I need to say what is input or references or predictions? or this is automatic?
metric = load_metric(‘bleurt’, ‘bleurt-large-512’)
for batch in dataset:
input, references = batch
predictions = model(inputs)
metric.add_batch(predictions=predictions, references=references)
score = metric.compute()
File “” line 14, in
input, references = batch
ValueError: too many values to unpack (expected 2)