Skip to content

Add single supervisory conformance controller for non-Go artifacts - #132

Merged
bigboateng merged 1 commit into
mainfrom
feat/conformance-controller
Jul 23, 2026
Merged

Add single supervisory conformance controller for non-Go artifacts#132
bigboateng merged 1 commit into
mainfrom
feat/conformance-controller

Conversation

@bigboateng

Copy link
Copy Markdown
Contributor

Why

Go source has a compiler that fails the build on malformed input. The repo's many non-Go artifacts — shell hooks, JSON configs, generated distribution files — had no equivalent gate. A merge-conflict marker or syntax error could land silently and break tooling at runtime. This is exactly what happened when a conflict-corrupted .product-loop/hooks/guard.sh produced a bash syntax error that blocked all agent tooling — and CI would not have caught it, because the per-lab workflows are path-scoped and never inspect repo-root/installed artifacts.

What

One compiled supervisory controller (conformance/) that gives non-Go artifacts the same guarantee, driven by an embedded, checked-in config (conformance/conformance.json):

  • conflict-marker scan + UTF-8 validation on every tracked non-binary file
  • bash -n on every tracked *.sh / *.bash
  • JSON validity on every *.json — with JSONC comment-stripping for tsconfig*.json/*.jsonc, and a JSON Lines fallback for .json data streams
  • best-effort PowerShell parse on *.ps1 when pwsh is present

It runs three ways so it can't be bypassed:

  • as a command: go run ./cmd/conformance
  • as a Go test: TestRepositoryConformance (in a go.work module, so go test ./... at root exercises it)
  • as a new always-on CI workflow (.github/workflows/conformance.yml) with no path filter, closing the gap where root-artifact edits never triggered a lab workflow

Fixture corpora that may hold intentionally-malformed input are exempt from the syntax checks only; conflict/UTF-8 scans still cover them.

Verification

  • go run ./cmd/conformancePASS: conformance clean — 27282 files scanned (64 shell, 15923 JSON, ...)
  • go test ./... green (detector unit tests + live-repo scan)
  • End-to-end: injecting a conflict-marked guard.sh is caught by two independent checks (conflict scan + bash -n), exit 1

Notes

Go source has a compiler that fails the build on malformed input; the
repo's many non-Go artifacts (shell hooks, JSON configs, generated
distribution files) had no equivalent gate. A merge-conflict marker or
syntax error could land silently and break tooling at runtime — as it did
when a conflict-corrupted .product-loop/hooks/guard.sh produced a bash
syntax error that blocked all agent tooling.

This adds one compiled controller that gives those artifacts the same
guarantee, driven by an embedded, checked-in config:

  - conflict-marker scan and UTF-8 validation on every tracked non-binary
    file
  - bash -n on every tracked *.sh / *.bash
  - JSON validity on every *.json (JSONC comment stripping for tsconfig;
    JSON Lines fallback for .json data streams)
  - best-effort PowerShell parse on *.ps1 when pwsh is available

It runs both as a command (go run ./cmd/conformance) and as a Go test
(TestRepositoryConformance) in a go.work module, and via a new always-on
CI workflow with no path filter, so violations are caught no matter which
lab a change touches — closing the gap where root-artifact edits never
triggered a lab workflow.

Fixture corpora that may hold intentionally-malformed input are exempt
from the syntax checks only; conflict/UTF-8 scans still cover them.
@github-actions

Copy link
Copy Markdown

Pitot coding-agent E2E

Intelligence Flow is the verification source; Pitot's public README carries the latest main status.

Agent Ubuntu macOS Windows Result Evidence
Claude ✅ Pass · real CLI 2.1.217 · native · binary-observed anthropic messages ✅ Pass · real CLI 2.1.217 · native · binary-observed anthropic messages ✅ Pass · real CLI 2.1.217 · native · binary-observed anthropic messages ✅ Passing All platforms are required
Cursor ✅ Pass · real CLI 2026.07.20-8cc9c0b · native · binary-observed cursor connect proto ✅ Pass · real CLI 2026.07.20-8cc9c0b · native · binary-observed cursor connect proto ✅ Pass · real CLI 2026.07.20-8cc9c0b · WSL · binary-observed cursor connect proto ✅ Passing All platforms are required
Codex ✅ Pass · real CLI 0.145.0 · native · binary-observed openai responses ✅ Pass · real CLI 0.145.0 · native · binary-observed openai responses ✅ Pass · real CLI 0.145.0 · native · binary-observed openai responses ✅ Passing All platforms are required
GitHub Copilot CLI ✅ Pass · real CLI 1.0.73 · native · binary-observed openai chat ✅ Pass · real CLI 1.0.73 · native · binary-observed openai chat ✅ Pass · real CLI 1.0.73 · native · binary-observed openai chat ✅ Passing All platforms are required
Gemini ✅ Pass · real CLI 0.51.0 · native · binary-observed gemini generate content ✅ Pass · real CLI 0.51.0 · native · binary-observed gemini generate content ✅ Pass · real CLI 0.51.0 · native · binary-observed gemini generate content ✅ Passing All platforms are required
Kimi Code ✅ Pass · real CLI 0.29.0 · native · binary-observed openai chat ✅ Pass · real CLI 0.29.0 · native · binary-observed openai chat ✅ Pass · real CLI 0.29.0 · native · binary-observed openai chat ✅ Passing All platforms are required
OpenCode ✅ Pass · real CLI 1.18.4 · native · binary-observed openai responses ✅ Pass · real CLI 1.18.4 · native · binary-observed openai responses ✅ Pass · real CLI 1.18.4 · native · binary-observed openai responses ✅ Passing All platforms are required
Pi ✅ Pass · real CLI 0.81.1 · native · binary-observed openai chat ✅ Pass · real CLI 0.81.1 · native · binary-observed openai chat ✅ Pass · real CLI 0.81.1 · native · binary-observed openai chat ✅ Passing All platforms are required
Qwen Code ✅ Pass · real CLI 0.20.1 · native · binary-observed openai chat ✅ Pass · real CLI 0.20.1 · native · binary-observed openai chat ✅ Pass · real CLI 0.20.1 · native · binary-observed openai chat ✅ Passing All platforms are required

Runtime capabilities

Capability Ubuntu macOS Windows Result
pitot request ✅ Pass · real runtime allow/deny ✅ Pass · real runtime allow/deny ✅ Pass · real runtime allow/deny ✅ Passing

Source commit: 04a5c7c368ba

@bigboateng
bigboateng merged commit 58ebfac into main Jul 23, 2026
40 checks passed
@bigboateng
bigboateng deleted the feat/conformance-controller branch July 23, 2026 12:42
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant