Extend codellama

Models
1

Hi,

I was playing with the model codellama the other day, but any model or interface could be applicable. Anyway, the simple questions for writing functions worked quite well, but when trying to reference libraries it kept inventing library functions which didn’t exist for that library.

So, I am after instructions on how to extend a (coding) model with data for specific libraries!?

I saw a few tutorials on how to fine tune, but most sounded like they were trying to refine the style of voice used in writing the response. Also they were always in the format of question and answer, which I guess I won’t really be able to get away from, however I could do with some examples of how to dump in library docs and code examples, any tips and tricks on doing this for greatest effect, etc

Many thanks

1 Like
2

In fields where accuracy of knowledge is required, it is faster to have an LLM with a dictionary (database) at hand than to teach the LLM everything. I think using the RAG approach is a good idea in this case.

Preventing hallucinations is another issue that is costly, but post-checking is not impossible.

3

Thankyou, I did do a RAG tutorial a few weeks ago, the pizza review one, I’ll have another look after reading

1 Like