The new dmr binary will operate in two modes: Daemon Mode and Client Mode. This allows a single binary to manage its own background processes without external container orchestration. This is not new, it’s model-runner and model-cli combined into a single binary. The existing dmr binary in the codebase may be discarded. This can be a from scratch rewrite since that was just a hacky development tool (it’s only ~100 lines of code anyway).
The Daemon (Service) Layer
The command “dmr serve” will initialize the background daemon. This service is responsible for model lifecycle management, resource allocation, and maintaining the state of active runs.
The CLI (Client) Layer
The CLI layer communicates with the local daemon to execute user commands. Standard operations include running models, listing active processes, and inspecting logs.
Examples
The binary must implement a single command-line interface. Below are some example commands:
dmr serve | Is the DMR daemon process that listens for and manages model execution requests.
dmr run [model] | Triggers the execution of a specific model via the running daemon.
dmr ls | Lists models. etc.
The new dmr binary will operate in two modes: Daemon Mode and Client Mode. This allows a single binary to manage its own background processes without external container orchestration. This is not new, it’s model-runner and model-cli combined into a single binary. The existing dmr binary in the codebase may be discarded. This can be a from scratch rewrite since that was just a hacky development tool (it’s only ~100 lines of code anyway).
The Daemon (Service) Layer
The command “dmr serve” will initialize the background daemon. This service is responsible for model lifecycle management, resource allocation, and maintaining the state of active runs.
The CLI (Client) Layer
The CLI layer communicates with the local daemon to execute user commands. Standard operations include running models, listing active processes, and inspecting logs.
Examples
The binary must implement a single command-line interface. Below are some example commands: