Skip to content

Just-in-time (JIT) Model loading via API ignores saved per-model settings #1463

Description

@tsebring

LM Studio version: 0.4.1 (Build 1)

When a model is loaded by Just-in-time (JIT) on the local server (e.g. by request to /v1/chat/completions) it will NOT load the per model settings configured in "My Models" section in LM Studio. Both LM Studio and the online documentation states that it is supposed to load those per model settings.

See https://lmstudio.ai/docs/app/advanced/per-model

You can set default load settings for each model in LM Studio.

When the model is loaded anywhere in the app (including through lms load) these settings will be used.

See LM Studio My Models tooltips:
Image

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions