I am replicating code from this page and I am getting F1, precision and recall to be 0. I got accuracy as shown by the author. What could be reasons?
I looked into compute_metrics function and it seems to be correct. I tried some toy data as below and precision_recall_fscore_support seems to be giving a correct answer
from sklearn.metrics import accuracy_score, precision_recall_fscore_support
y_pred = [1, 1, 2]
y_true = [1, 2, 2]
print (accuracy_score(y_true, y_pred))
precision_recall_fscore_support(y_true, y_pred, average='binary')
0.6666666666666666
(0.5, 1.0, 0.6666666666666666, None)
as I am getting the accuracy it seems that the below part is working as expected
labels = pred.label_ids
preds = pred.predictions.argmax(-1)
acc = accuracy_score(labels, preds)