[Bug]: LLM Studio does not connect

[xcytxs]

Version

VisualStudio Code extension

Operating System

Windows 11

What happened?

By changing the endpoint and api key from Openai to LLmStudio:

if using

OPENAI_ENDPOINT=http://localhost:1234/v1

There was a problem with request to openai API:
string indices must be integers, not 'str'

It is not the one to use but just to troubleshoot i used this to see what happened

OPENAI_ENDPOINT=http://localhost:1234/v1/chat/completions

2024-03-28 06:21:00,853 [llm_connection.py:411 - stream_gpt_completion() ] INFO: > Request model: gpt-4-turbo-preview
2024-03-28 06:21:00,872 [llm_connection.py:468 - stream_gpt_completion() ] INFO: problem with request (status 500): {"error":"Model with key 'gpt-4-turbo-preview' not loaded."}
2024-03-28 06:21:00,872 [llm_connection.py:274 -              wrapper() ] ERROR: There was a problem with request to openai API: API responded with status code: 500. Request token size: 23 tokens. Response text: {"error":"Model with key 'gpt-4-turbo-preview' not loaded."}

[juxstin1]

Try changing endpoint from openai to lmstudio, pre sure its a new update

ENDPOINT=lm-studio

[catarino]

You have to change the following lines in the .env file

OPENAI_ENDPOINT=http://localhost:1234/v1/chat/completions
OPENAI_API_KEY=lm-studio

(Replace lm-studio with the key you have setup in LM Studio)

[techjeylabs]

solved, therefore closing