Hi everyone
i want to build a RAG for chatting with PDFs, running solely on CPU, accessible via web for multiple users, with reasoning capability (like DeepSeek-R1)
i appreciate your helps and comments <3
(update)
i want something easy to deploy and easy to use
i saw a video on youtube (https://www.youtube.com/watch?v=M6vZ6b75p9k)
that explains it very well but
its not working well with only cpu
i want something like that doable.
1 Like
Hi, @zoghiboy
First, I will appreciate your effort.
And RAG and LoRA are both good methods to chat with your document.
If you don’t satisfy the result, I recommend you to use RAG.
In RAG you can use vector database. This is very effective way to chat with your document.
But you should consider the response time. Which db service you choose, the time limit is different.
And you can also use some APIs like deepseek or openai free apis.
You can also view my examples.
If you want to help from me, I will be here anytime for you.
1 Like