I am a beginner on this field and looking for a solution on how can i train my own LLM ?
In past few months I have tried the chatbot solution with openAI prompt engineering using langchain, pinecone DB to store my personal data.
But now, i need some help on how can i do it without prompt engineering and vector database. How can i train my own model and get results from it.
Can anyone help me out here with some insights on this matter, like which base model should i try ? how much data would i need ?
I’m also new to and interested in training a model.
Somewhat related, I wrote a short article which disambiguated the different methods for me. Very basic, but maybe it might be useful:
I wonder if you might find fine-tuning to be helpful? I’m sure there are much better (and probably cheaper) options here with . Maybe the training isn’t that difficult, but OpenAI has a pretty straightforward approach for fine tuning:
Lots of tutorials out there depending on what your favorite language is, and I’ve seen no-code options also.