-
Notifications
You must be signed in to change notification settings - Fork 0
Roadmap
Your GitHub Name edited this page May 20, 2026
·
7 revisions
PromptPilot's roadmap holds two principles:
- The SLM stays the harness brain — it does not become the coder.
- When the SLM is uncertain, the correct action is passthrough.
The pieces below are in main and covered by the test suite.
-
v2 control plane — JSON
ExecutionSpecwithroute ∈ {clarify, answer, passthrough, act}plusintent,scope,target_files,risk,memory_record. v1 prose envelope kept as fallback parser. (prpt/core/spec.py, prpt/normalizers/slm_openai_v2.py) -
Four interchangeable judges —
MaxHaikuJudge,CodexCliJudge,AnthropicApiJudge,OpenAiJudge, auto-detected in priority order. (prpt/judges/judge.py) - Hybrid auth pattern — API-key SLM + subscription LLM, ~4,500× subsidy ratio measured on chain5. (Hybrid Mode, Benchmarks)
-
Handoff / restart workflow —
prpt checkpoint,prpt bootstrap,prpt restartfor collapsing heavy sessions tohandoff.mdand resuming fresh. (prpt/handoff.py) -
Session memory with referential gate — recent turns prepended;
--gate-sessionclassifier skips history when prompt is self-contained. Default-on after N=5 chain1 retest showed +60% success / −28.7% cps for WITH-session. -
Onboarding subcommands —
prpt setup(one-time, with smoke test),prpt doctor(re-check, no install),prpt install-hookfor both Claude Code and Codex. -
Tool-output compression hook — regex-based
PostToolUsecompressor for pytest / grep / git diff / installer logs. (.codex/hooks/compress_tool_output.py) - Compliance posture documentation — side-by-side breakdown vs the OpenClaw / OpenCode pattern enforced April 2026. (Comparison)
-
Wiki publishing automation —
scripts/publish_wiki.shkeeps the wiki mirrored fromdocs/. (Wiki Publishing)
- Honest measured benchmarks — chain1, chain4, chain5 numbers are landed; broader workload coverage (Django / Rails / JS repos) not yet measured.
-
Route-accuracy fixture set — labelled prompts to score
clarify/answer/passthrough/actdecisions, not just per-call cost. - Preservation recall metrics — programmatic checks for file paths, test names, commands, flags, symbols, stack frames, and explicit constraints.
- Cross-provider / model-size A/B for the SLM harness (Haiku vs gpt-5.4-nano vs gpt-5.4-mini).
- Surface high-risk transformations to the user before invoking the coding agent.
- More worked passthrough and compression examples.
- Easier telemetry inspection during replay (current
prpt statsis a flat JSONL summary).
- Replacing frontier coding models with the SLM.
- Maximizing token reduction when context may be lost.
- Letting the SLM make irreversible code changes.
- Token handling for subscription auth (we invoke the official binary; the credential never enters our process).
See also: Benchmarks · Telemetry and Replay · Wiki Publishing