Skip to content

issues Search Results · repo:docker/model-runner language:Go

Filter by

6 results
 (77 ms)

6 results

indocker/model-runner (press backspace or delete to remove)

docker/model-runner
Feature: MLX backend

Hello there! It looks like you are planning to support MLX backend eventually, since there is already a mock in the code. Opening this issue mostly to be able to subscribe to it to know when it happens. ...
  • gyzerok
  • 2
  • Opened 
    5 days ago
  • #90

docker/model-runner
Feature Request: Make model timeouts for unloading from memory configurable

Summary Allow developers to set different timeouts when loading models for when the model is purged from memory. Motivation Many model use cases are latency-sensitive and potentially long-running. For ...
  • chpiatt
  • Opened 
    12 days ago
  • #84

docker/model-runner
Feature Request: Support running multiple models concurrently

Summary Add support for serving multiple models concurrently Motivation I would like to be able to use Docker Model Runner to serve both my primary model and my embedding model (and any other model ...
  • chpiatt
  • 3
  • Opened 
    12 days ago
  • #82

docker/model-runner
Illegal instruction (core dumped) when running qwen3:8B-Q4_K_M

$ docker model run ai/qwen3:8B-Q4_K_M Unable to find model ai/qwen3:8B-Q4_K_M locally. Pulling from the server. ...
  • shockme
  • 7
  • Opened 
    18 days ago
  • #71

docker/model-runner
Feature Request: Add OCR Backend Support for Local Document Processing

Summary Propose adding an OCR (Optical Character Recognition) backend to enable local document text extraction capabilities within Docker Model Runner. Motivation - Expand Docker Model Runner beyond ...
  • 20yuto20
  • Opened 
    27 days ago
  • #64

docker/model-runner
Linux support

Hi, and first of all thanks for this marvelous initiative. Is there any tentative schedule on when docker model runner will be available for Linux systems? All the best!
  • tepelbaum
  • 2
  • Opened 
    on Apr 29
  • #25
Issue origami icon

Learn how you can use GitHub Issues to plan and track your work.

Save views for sprints, backlogs, teams, or releases. Rank, sort, and filter issues to suit the occasion. The possibilities are endless.Learn more about GitHub Issues
ProTip! 
Press the
/
key to activate the search input again and adjust your query.
Issue origami icon

Learn how you can use GitHub Issues to plan and track your work.

Save views for sprints, backlogs, teams, or releases. Rank, sort, and filter issues to suit the occasion. The possibilities are endless.Learn more about GitHub Issues
ProTip! 
Press the
/
key to activate the search input again and adjust your query.
Issue search results · GitHub