Error connecting to lm studio

John6666 · February 9, 2025, 8:50am

I don’t know much about LM Studio, but I found a case study of a similar error.

Connection error when using lm-studio

opened 04:35AM - 15 Jul 24 UTC

closed 04:06PM - 29 Aug 24 UTC

Hi, I tried to use local LLM with lm-studio but it returned me as connection err…or. My sample code is modified from https://github.com/zou-group/textgrad/blob/main/textgrad/engine/local_model_openai_api.py First, it seems that the example code does not work, because prompt is not an argument, but content, for ChatExternalClient. For the code: ```python from openai import OpenAI from textgrad.engine.local_model_openai_api import ChatExternalClient client = OpenAI(base_url="http://localhost:1234/v1", api_key="lm-studio") engine = ChatExternalClient(client=client, model_string="your-model-name") print(engine.generate(max_tokens=40, prompt="What is the meaning of life?")) ``` I met such an error: ``` st_to, options, remaining_retries, stream, stream_cls) 1011 log.debug("Raising connection error") -> 1012 raise APIConnectionError(request=request) from err 1014 log.debug( 1015 'HTTP Response: %s %s "%i %s" %s', 1016 request.method, (...) 1020 response.headers, 1021 ) APIConnectionError: Connection error. ``` Does this mean I cannot create a client from local machine? Thanks.

Topic		Replies	Views
Lm studio and Chat ui doesn't work with module Beginners	11	595	December 21, 2024
Connection error in transformers 🤗Transformers	0	1017	June 22, 2021
Value error : Connection error 🤗Transformers	8	16226	August 4, 2021
Inference Model with API and Integrate to LM (Language Model) 🤗Transformers	0	643	June 7, 2022
Error with gradio application with openai 🔒 Gradio	4	1443	June 20, 2023

Error connecting to lm studio

Related topics