Hi, I recently fine-tuned the Rag model (based on Rag-token-base) in WebQuestion, but the EM score is only 28. The performance in the paper is 45. Do you have any saved models that can match the performance, or does there any tricks during the fine-tuning?
Related Topics
Topic | Replies | Views | Activity | |
---|---|---|---|---|
RAG Model performance does not match paper | 0 | 318 | February 5, 2021 | |
RAG Model for QA | 1 | 1284 | December 30, 2023 | |
Is it mandatory to fine tune a RAG model on custom dataset to generate realted responses for queries, i working on RAG code from the examples , when i use a custom datast=et it doesnot produce intended results for queries | 0 | 225 | September 5, 2023 | |
Although doing RAG does it worth fine tuning the LLM on the documents? - Llama2 | 1 | 1367 | September 14, 2023 | |
RAG for FEVER Dataset | 0 | 391 | February 8, 2021 |