Skip to content

Model catalog - Add LM Studio model #218

@garrytrinder

Description

@garrytrinder

LM Studio is a powerful, user-friendly desktop application that allows you to run large language models (LLMs) locally on your own machine.

Currently, the AI Toolkit has a quick way to add models from Ollama, however adding LM Studio models is not as easy.

To add a model (phi-4) from LM Studio you need to follow these steps:

  1. Add custom model
  2. Endpoint URL: http://127.0.0.1:1234/v1/chat/completions
  3. API model name: microsoft/phi-4
  4. Model display name: microsoft/phi-4
  5. Auth header: Leave empty
  6. Open in Playground

It would be great if Add LM Studio model was included as a another option alongside Add Ollama model to shorten these steps.

Metadata

Metadata

Assignees

Labels

feature requestThe issue is a feature requestneeds attentionThe issue needs contributor's attention

Type

No type
No fields configured for issues without a type.

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions