How do I utilise a locally running LLM in my ReactCodeAgent? For example, I am wanting to run a text-to-sql agent but I am struggling to get it running via a local llm. I am open to using ollama if that is simpler?
Related topics
Topic | Replies | Views | Activity | |
---|---|---|---|---|
Is it possible to fine tune a Local LLM pulled from Ollama to perform toolcalling/function calling better! | 3 | 56 | August 22, 2025 | |
Class transformers.ReactAgent | 0 | 34 | November 22, 2024 | |
Powerful interface for local and remote llms | 0 | 210 | April 13, 2024 | |
Local LLM not working; just produces gibberish. Looking for help for a beginner | 1 | 214 | February 17, 2025 | |
Tool/Function calling abilities of LLM's that are used locally pulled through ollama | 2 | 74 | August 1, 2025 |