I agree focusing on open source based local AI is increasing privacy - if you don’t know this repo already, I find it useful and inspiring LM Studio · GitHub
TGI sounds like a good fit for your app don’t you think?
1 Like