Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

LM Studio config appending /v1/ to url request #713

Closed
1 of 3 tasks
teebu opened this issue Dec 28, 2023 · 1 comment
Closed
1 of 3 tasks

LM Studio config appending /v1/ to url request #713

teebu opened this issue Dec 28, 2023 · 1 comment
Labels
bug Something isn't working

Comments

@teebu
Copy link

teebu commented Dec 28, 2023

Before submitting your bug report

Relevant environment info

- OS: Windows
- Continue: v0.6.18

Description

LM Studio url appends /v1/ to url, resulting in:

Error visible in LM Studio logs:

[2023-12-28 14:58:31.771] [ERROR] Unexpected endpoint or method. (POST /v1/v1/chat/completions). Returning 200 anyway

Standard Config:

    {
      "title": "Mistral",
      "model": "dolphin-2.6-mistral-7b",
      "contextLength": 4096,
      "provider": "lmstudio"
    }

Fixed by manually adding apiBase setting in config:

    {
      "title": "Mistral",
      "model": "dolphin-2.6-mistral-7b",
      "contextLength": 4096,
      "provider": "lmstudio",
      "apiBase": "http://localhost:1234"
    }

The code set here hard codes the v1:
https://github.com/continuedev/continue/blame/b162e8703a357c8d365cd6073bbc7fbb58ad527f/core/llm/llms/LMStudio.ts#L7

To reproduce

No response

Log output

No response

@teebu teebu added the bug Something isn't working label Dec 28, 2023
@sestinj
Copy link
Contributor

sestinj commented Dec 29, 2023

Thanks for the report, I fixed it in two ways in this commit, which I will publish a version for later tonight

@sestinj sestinj closed this as completed Jan 5, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

2 participants