-
Notifications
You must be signed in to change notification settings - Fork 0
Why Deterministic Gates
github-actions[bot] edited this page Jun 7, 2026
·
3 revisions
Crickets gates every change on deterministic checks — typecheck, lint, tests, build — before any LLM judgment is consulted. Deterministic checks are cheap, repeatable, and truthful: a test either passes or it doesn't, and it says so the same way every time. LLM judgment is expensive and can be sycophantic — it may bless output a compiler would reject.
So the order is fixed: machines verify what machines can verify; the LLM augments at the margins — review, naming, intent — and never replaces the gate. A green LLM opinion sitting on top of red tests is worthless, so the red tests run first and win.
- Continuous-integration gating — the established practice of blocking a merge on automated checks rather than on human (or model) sign-off alone.
- LLM-as-judge reliability — using a model to grade output is useful but unreliable as a sole gate; deterministic checks anchor it so the judgment has something solid to stand on.