I just saw that Facebook AI released a blog post about RAG ( Retrieval Augmented Generation: Streamlining the creation of intelligent natural language processing models) and that it is already incorporated in the HuggingFace API . I looked quickly, and I couldn’t see how to use a custom dataset wit…

RAG custom dataset

thomwolf September 30, 2020, 12:31pm 2

Indeed, it’s actually very simple to do with datasets and somehow explained on this page: https://huggingface.co/docs/datasets/faiss_and_ea.html

We will add an example script on this.

1 Like

Topic		Replies	Views
How do we insert our own datasets in DPR / RAG retrieval Q&A models? 🤗Transformers	1	1640	October 11, 2020
Rag model set up 🤗Transformers	0	696	November 7, 2023
Using RAG with local documents Models	3	3676	April 21, 2021
Is it mandatory to fine tune a RAG model on custom dataset to generate realted responses for queries, i working on RAG code from the examples , when i use a custom datast=et it doesnot produce intended results for queries Beginners	0	230	September 5, 2023
Use RAGAS with huggingface LLM Intermediate	17	9715	March 17, 2025