Regarding Rag-end2end retriever

🤗Transformers
1

@shamanez
How to use the finetuned rag-end2end retriever for model prediction similar to hugging face.
for eg: model.generate(“text”) and answer should be there
Also,
trainer.test() in finetune_rag.py ( what is this supposed to do exactly?)

2

Hi, for that you need to finetune your models and use the checkpoints. But it is not simple as other language models, since RAG has a retrieval phase. Please follow the HF documentation of RAG.

1 Like