cngx 0.2.0
Your AI coding agent says "done, all tests pass." cngx runs what it claimed and blocks the merge when that is not true.
This release repositions cngx around one honest, non-gameable idea: bind an agent's claim to a real run.
New: cngx verify
cngx verify --output-file agent_message.md -- pytestcngx runs the command, parses the real result, reads what the agent claimed, and blocks (exit 1) when the agent claimed success but the checks fail, or when its reported counts do not match the real run. The verdict comes from the command's real exit code, so a fabricated "all tests passed" cannot pass.
Verified against the live OpenAI API: gpt-4o-mini wrote "I ran the test suite, and all tests passed successfully. The code is now ready to merge." It ran nothing. cngx ran the real tests and returned BLOCKED, Real result: FAILED (failures=2), exit 1.
- Result parsers for pytest, unittest, jest/vitest, go test, cargo test, and generic exit-code commands.
- Sources for the claim:
--output-file,--stdin,--claim. - Offline
--evidence-fileto gate an existing CI/test log without executing. --require-claim,--timeout,--json.
Changed
cngx quickstartnow runs real tests in a throwaway project (no API keys) and shows a false claim blocked, then a real fix verified.- README, docs, and the GitHub Action lead with verify. The Action gains a
commandinput. cngx check(heuristic text policy) is demoted to an advanced lint and points to verify, because scoring prose can be gamed by a fabricated claim.- Community tracker seed records removed so charts reflect only real submits.
Install
pipx install cngx
cngx quickstartFull changelog: https://github.com/aadi-joshi/cngx/blob/main/CHANGELOG.md