I am an experienced javascript and python developer, but I am new to AI and LLMs - and HuggingFace - sorry if this is the wrong place/forum for this.
I want to develop custom AI assistants/tools that run on a local machine using cloud based apis.
As a first Hello World
project, I’m thinking a terminal based interactive AI chatbot that just answers questions like any general web based AI chatbot - but running locally, written in python, & using a Hugging Face API. I don’t have a particular model in mind, I want to experiment - llama, mistral, etc.
Does that seem like a reasonable starter project?
I’m digging through the docs & getting there - but this must have been done a thousand times before. If anyone some links/guidelines/templates/tutorials to get started, that would be great.
Thanks,
Paul