I was trying to build a RAG LLM model using opensource models. but while generating the response the llm is attaching the entire prompt and relevant document at the output. can anyone please tell me how can I remove the prompt and the Question section and get only the Answer in response ? Code: fr…

RAG LLM Generating the Prompt also at the response

vpkprasanna May 19, 2024, 4:24pm 8

I would highly recommend to follow this link to understanding the prompt format for llama2

Topic		Replies	Views
How can I prompt Llama to only use my provided context? 🤗Transformers	1	1688	March 2, 2024
Getting Additional response from my RAG using HuggingFaceEndpoint inference Beginners	3	65	March 16, 2025
Generate() returns full prompt plus answer 🤗Transformers	1	6667	February 19, 2024
Llama-2 7B-hf repeats context of question directly from input prompt, cuts off with newlines 🤗Transformers	16	29247	January 10, 2025
RetrievalQA output repeats prompt and context sources Models	0	101	July 26, 2024