|
About the 🤗Evaluate category
|
|
0
|
581
|
June 9, 2022
|
|
Why can't I do MLM on a huggingface automatic eval
|
|
0
|
15
|
June 1, 2023
|
|
Token Classification Evaluator prediction missing words
|
|
0
|
19
|
May 31, 2023
|
|
How to plot results from trainer_state file?
|
|
1
|
169
|
May 23, 2023
|
|
Error message with Inference for Image Classification
|
|
0
|
39
|
May 21, 2023
|
|
Combining metrics for multiclass predictions evaluations
|
|
20
|
4153
|
May 16, 2023
|
|
Using evaluate scripts without internet connection
|
|
0
|
62
|
May 3, 2023
|
|
Use "evaluate" to add compute_metrics to custom trainer
|
|
0
|
83
|
May 2, 2023
|
|
Putting Evaluate Model on GPU
|
|
0
|
54
|
May 1, 2023
|
|
FileNotFoundError: Couldn't find a module script at ...precision/precision.py. Module 'precision' doesn't exist on the Hugging Face Hub either
|
|
1
|
92
|
April 27, 2023
|
|
SetFit Evaluate on the Hub
|
|
0
|
59
|
April 21, 2023
|
|
Evaluate with pipeline on custom dataset
|
|
0
|
106
|
April 7, 2023
|
|
Top-5 (k) Accuracy Score in Multi Class Single Label
|
|
3
|
494
|
April 6, 2023
|
|
Use evaluate library on a non-Hugging Face model
|
|
0
|
66
|
March 27, 2023
|
|
[Feature Request] Adding default compute_metrics to popular evaluate metrics
|
|
2
|
155
|
March 16, 2023
|
|
Plot the pr curve for squadv2
|
|
0
|
110
|
February 18, 2023
|
|
Evaluate/metrics/mean_iou computes recall (sensitivity) instead of IoU
|
|
0
|
126
|
February 14, 2023
|
|
Difference in results using trainer.evaluate() and pipeline inference
|
|
0
|
159
|
February 8, 2023
|
|
Is there a way to print the evaluation after each eval_steps
|
|
0
|
156
|
February 6, 2023
|
|
Add a new evaluation metric without using the evaluate-cli
|
|
0
|
133
|
January 25, 2023
|
|
Evaluate.load() does not working but datasets.load_metric() does
|
|
2
|
503
|
January 3, 2023
|
|
Trainer.evaluate() >> TypeError: vars() argument must have __dict__ attribute
|
|
1
|
1137
|
December 26, 2022
|
|
Can I compute the class-wise metrics using the `compute()` function?
|
|
0
|
213
|
December 17, 2022
|
|
What is `sample_weight` used for in the `compute()` function?
|
|
0
|
277
|
December 17, 2022
|
|
Cache directory and device map for model used for perplexity evaluation
|
|
0
|
250
|
December 15, 2022
|
|
Compute_metrics slowdown
|
|
7
|
604
|
December 6, 2022
|
|
Error when evaluating BLEU score using HuggingFace evaluate
|
|
2
|
724
|
December 6, 2022
|
|
How to get Evaluator stats per image label/class?
|
|
2
|
316
|
November 22, 2022
|
|
Mean_iou - how come it can be greater than 1?
|
|
0
|
420
|
October 22, 2022
|
|
Evaluate doesn't play nicely with Accelerate in multi-GPU settings
|
|
3
|
2962
|
September 23, 2022
|