RAG Retriever: hf vs legacy vs exact vs compressed

[Jung]

Hi! The last question was answered here : RAG Retriever : Exact vs. Compressed Index? - #4 by lhoestq

@lhoestq

exact vs compressed refers to the quantization used for the FAISS index. The compressed one uses an IVF index with product quantization and requires significantly less RAM than the exact one. To reproduce the RAG papers result you will need the exact one though.
Note that I will update this week the parameters of both index so that the exact one uses the same as RAG’s paper, and also to have an optimized compressed one.