.knowledge 3.4.0 is out: a task-scoped workflow, a 9-cell compatibility matrix, and a 48-case routing stress test—without invented claims #5
pro2pilot
announced in
Announcements
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
AI coding agents do not always fail because they lack context.
Often, the opposite is true: they receive too much context, its freshness is unknown, evidence is separated from the final result, and repository knowledge remains in an ambiguous state even after a test passes.
.knowledge3.4.0 connects those pieces into one repo-local workflow:What is new in 3.4.0
agent-task beginBefore broad repository exploration, the agent receives the current task snapshot and the exact
first-read.md:node .knowledge/tools/agent-task.js begin \ --task="Update the orders route and its shared mapping" \ --scope-module=orders_app \ --scope-path=apps/orders/ \ --jsonThe response binds the task, scope, first-read body, SHA-256, and byte count.
agent-task finishAfter the code change, the workflow physically executes the requested checks, stores native verification evidence, and may reuse that evidence for one exact, safe Repair-on-touch closure:
A test is not rerun merely to produce a more attractive repair counter. If the evidence, lifecycle, or final recertification does not hold, the repair remains open.
Recovery and fail-closed boundaries
finishuses a durable journal and lock-serialized recovery. Repeating the same request is idempotent; changing the request is rejected. An unknown side effect is not guessed at or silently repeated.Request files and test working directories must remain inside the repository boundary. Symlink, junction, hardlink, and traversal escapes are rejected.
What the tests showed
3.2.11 → 3.4.0upgrades on Node 22The 48-case suite covered ownership routing, direct dependencies, active-versus-legacy paths, feature and configuration indirection, migrations, critical-path incidents, generated mirrors, and API boundaries. Every route was current, ready, and complete; every required dependency was selected.
Supported agent runtimes
Codex, Claude Code, OpenCode, OpenClaw, Hermes, Gemini CLI, GitHub Copilot, Devin, Windsurf, Continue, Roo Code, Aider, and others.
Why the failed tests matter too
Since 3.2.11, we have blocked our own release candidates and studies several times:
We did not delete those outcomes or convert them into marketing claims.
That is why we are not claiming that
.knowledgemade the model intrinsically smarter or improved model accuracy by X%. We do not yet have a valid final model-level proof for that statement.The strongest supported conclusion is different:
What that changes in practice
Field Reports
The most useful contribution to the project right now is a real Field Report from a real repository.
A Field Report can be prepared in two ways:
field-reportworkflow, where the agent collects observable facts, asks for the missing human context, prepares a draft, and leaves publication under your control.Field Report is designed as a local, reviewable workflow, not as an automatic export of repository internals:
Read the full explanation: How Field Reports work.
Publish your own report in the Field Reports category.
Try it
Install the release asset
knowledge-v3.4.0.zip, not GitHub's generated source archive. After import, start a meaningful task withagent-task beginand finish it withagent-task finishplus physical tests.The next public benchmark should be built around real repository patterns. Which scenario should we test first: monorepo ownership, stale documentation, generated source-of-truth, PR impact, or multi-agent handoff?
Evidence boundary
All reactions