Skip to content

Context size mismatch #407

@juangcarmona

Description

@juangcarmona

After our 'recent' conversations, regarding context size, I've been using the docker model package you implemented recnetly. Thanks a lot for that. But today, after an update, I noticed that, despite I am using a package with a "huge" context size, it still appears as 4096 on the UI.

Image Image

I don't know if this is just a "cosmetic" bug or it is not considering / applying the configured context_size.doc for real.

docker --version
Docker version 28.5.1, build e180ab8

docker model version
Docker Model Runner version v0.1.46
Docker Engine Kind: Docker Desktop

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions