Hello,
I am finetuning an LLM to adopt a specific teaching methodology, I have some papers and articles and a huge book about this methodology. How should i proceed ?
Thank you
1 Like
There is a lot to do, but first, you maybe need to decide whether to use a RAG-based approach and then select a base model.
If you use a RAG-based approach, even smaller models such as 3B to 7B can achieve decent performance.
If you want to pack knowledge into an LLM alone, you will need a larger model.
Thank you for your response. I think for my case finetuning would be the better option since I already want it to adopt this teaching methodology as a whole personality and my data won’t change and be external, it’s just once and then I will use this finetuned version for other tasks in the future.
1 Like