Currently I’m trying to get the LM evaluation harness running without success. I was curious if there is an easy way to Benchmark or evaluate pre-trained Generative text models inside the hugging face Library. I’m sorry if this is really obvious.
Related topics
Topic | Replies | Views | Activity | |
---|---|---|---|---|
New to Huggingface | 0 | 487 | June 10, 2023 | |
Evaluating my own model | 6 | 99 | February 21, 2025 | |
ModelClash: Dynamic LLM Evaluation Through AI Duels | 0 | 45 | July 22, 2024 | |
Retrieval Augmented Generation using Transformer Eco System | 0 | 461 | October 12, 2023 | |
Evaluate fine-tuned LLM for question answering | 1 | 33 | May 2, 2025 |