Skip to content

[Roadmap] DMI Roadmap — 2026 Q2 #47

@Samfisheryu

Description

@Samfisheryu

Tracking issue for the next development cycle following the public release (#32).

Near-term

  • Manual model coverage — most vLLM models and mainstream HF models, using hidden_states and logits hook points only.
  • Model Hook Compiler — auto-generate hooked model files from a spec. Active branch: feat/hook-compiler. Tracked in Hook Interface & Model Compiler — Auto-inject HookPoints into model files #36.
  • Compiler-driven model coverage — use the compiler to expand existing models to full internal hook points (attention / MLP / residual / etc.).
  • Policy Manager — unify selection, sampling, triggers, and backpressure into one declarative Policy object consumed per-run by adapters.
  • Expert Parallel (EP) support

Mid-term

  • New backend adapter: SGLang
  • CI/CD

Long-term

  • Explore online monitoring (streaming analytics on captured internals)
  • Explore agentic workflows on top of DMI

Metadata

Metadata

Labels

No labels
No labels

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions