Releases: ismaelsoilet/jev-harness
Release list
Release v0.2.0
Release v0.2.0 — System 1.5 Architecture, Provider Resilience & Tri-Runtime Parity
Data da pesquisa e calibração: 23 de setembro de 2026
Suíte de verificação: 569 testes verdes (393 Python + 89 TypeScript + 87 Rust) · 100% paridade tri-runtime
🌟 O que há de novo na v0.2.0
Esta versão consolida o jev-harness como a camada de decisão System 1.5 para o ciclo de qualidade de agentes autônomos de código, elevando robustez, rastreabilidade e calibração empírica.
🦀 Paridade Rust Live & Quebra Semver Controlada (0.x)
- Correção no parser live de
Score: suporte completo a floats (f64), mapas de legenda e probabilidades em respostas do provedor. - Assinatura pública ajustada:
JevClient::retry_delay_ms(Option<f64>)(suporte a frações emRetry-After) e retorno de erro explícito emparse_api_response.
🔁 Resiliência de Provedor & Degradação Fail-Open
- Política de retry com backoff exponencial suave e leitura rigorosa de headers
Retry-After(429, 5xx e timeouts). - Política padrão fail-open com marcação clara da causa de degradação (
degraded_reason:auth_401,http_429,http_500,timeout,connection,invalid_response). - Suporte a
--fail-closedpara pipelines rígidos e flag--retries N. - Respostas malformadas HTTP 200 tratadas como falhas de primeira classe sem traces não tratados.
🛡️ Limites de Payload, Redação de Segredos & Detecção de Injeção
- Validação prévia de payload (128.000 code points para estado, 256.000 total) nos 3 runtimes.
- Redação automática de credenciais e tokens sensíveis em todos os campos de saída e requisições de rede.
- Detector determinístico de injeção em logs de teste não confiáveis, forçando escalonamento de julgamento (nunca
skip_llm=true).
👻 Shadow Mode & Auditoria Completa
- Flag
--shadow(ou"shadow": trueem.jev.json): avalia e reporta[SHADOW] would exit Nsem bloquear pipelines. - Ferramenta de diagnóstico
jev-harness doctor(inspeção de credenciais mascaradas, permissões de diretórios, hooks e limites). - Trilha de auditoria append-only com
jev-harness receipts(permissões restritas0600, TTL e hashes de integridade). - Separação entre métricas medidas em tempo real e estimativas heurísticas no
jev-harness metrics. - Cache de decisão local baseado em hash de entrada com relatório de hit-rate (
--no-cache).
📊 Calibração Empírica & Paridade 100% Travada
- Corpus com 160 casos rotulados (
tests/corpus) e comandoreplayintegrado para cálculo de acurácia, macro-F1 e ECE. - Fixture de paridade tri-runtime (
tests/fixtures/corpus_parity.json) garantindo decisões idênticas em Python, TypeScript e Rust. - Exemplos prontos de GitHub Action (
examples/github-action/) para triagem de CI em runners Linux, macOS e Windows.
📦 Comandos de Instalação nos 4 Canais
1. Python (PyPI)
pip install --upgrade jev-harness2. TypeScript / JavaScript (npm)
npm install -g @ismaelsoilet/jev-harness
# ou executar via npx
npx @ismaelsoilet/jev-harness --help3. Rust (Crates.io)
cargo install jev-harness
# ou como dependência em Cargo.toml:
# jev-harness = "0.2.0"4. GitHub Releases & Standalone Binaries
Baixe os binários e códigos fontes diretamente da release oficial no GitHub:
https://github.com/ismaelsoilet/jev-harness/releases/tag/v0.2.0
Full Changelog: v0.1.14...v0.2.0
Release v0.1.14
Full Changelog: v0.1.13...v0.1.14
Release v0.1.13
Full Changelog: v0.1.12...v0.1.13
v0.1.12 — Green runs never block, working pre-commit hook & provider access guide
⚡ v0.1.12 — Green runs never block, working pre-commit hook & provider access guide
Frontier model registry and provider access re-verified by web research on September 23, 2026 (TypeSafe AI console, OpenCode Zen, Command Code, OpenRouter alpha, Vercel AI Gateway).
✅ Green runs never block or escalate
- A strict, deterministic success detector runs before any API call. Passing summaries from pytest, vitest, jest, cargo, go, mocha, rspec and unittest return
category: "no_failure",skip_llm=trueand exit0— with zero network calls. - Fixes false failures in pre-commit/husky recipes for JavaScript and Rust projects (e.g.
vitest run | jev-harness test-gatepreviously exited1on a fully green suite). - Real failures always veto the shortcut: non-zero
failed/failing/errorcounts (including comma, space, underscore and non-ASCII digit formats),failures:/failures=assignments,N test failed,FAIL/FAILEDmarkers, go's--- FAIL:, tracebacks, panics,Error:, failure glyphs and dependency/transient signals. no_failureis not counted in the ROI telemetry, so savings estimates stay honest.
🪝 Pre-commit integration that actually works
.pre-commit-hooks.yamlnow uses a console entry point (jev-test-gate) that runs from any consumer directory; the previousentry: bash scripts/...was resolved in the consumer's working directory and failed with exit127.scripts/jev_test_gate_hook.shremains available for shell and husky users.jev-harness init --git(Python, TypeScript and Rust) detects your runner (npm/pytest/cargo/unittest), writes a failure-only hook usingpython3, marks it executable, recognises pre-v0.1.12 hooks and never overwrites a foreign hook (it writespre-commit.jevinstead).
🔐 Hardening
~/.config/jevis created0700;session.jsonand the lock file are written0600, so telemetry error snippets are no longer world-readable.- TypeScript CLI reads stdin through an async iterator:
fs.readFileSync(0)threwEAGAINon streaming pipes (the documentednpm test | ... test-gaterecipe) for logs above ~64 KB. - TypeScript CLI prints the deterministic no-failure verdict (Rust and Python already did).
📖 Documentation
- Provider access and API-key acquisition for every backend: TypeSafe (console.typesafe.ai), OpenCode Zen (opencode.ai/auth,
jev-1.13-free), Command Code (signup +cmd login), OpenRouter (alpha, requires access), Vercel AI Gateway — plus a verification date and a mandatory 30-day re-verification rule for agents. - Explicit privacy matrix: offline mode makes zero network calls; live mode transmits the typed questions and the raw log (head 2,000 + tail 4,000 characters). Secret redaction applies to error messages, not to the log payload.
- Corrected pre-commit, husky and CI recipes, documented
no_failurebehaviour and detector scope in README (EN/PT) and both integration guides.
🧪 Verification
207 tests, 100% passing — 113 Python, 49 Rust, 45 TypeScript. Zero cargo clippy warnings, actionlint clean, quad-manifest parity verified. Three independent adversarial review rounds found and we fixed a masking regression introduced by the first repair attempt.
📦 Install
pip install jev-harness==0.1.12 # Python (PyPI)
npm install @ismaelsoilet/jev-harness@0.1.12 # TypeScript / Node (npm)
cargo add jev-harness@0.1.12 # Rust (crates.io)
git clone https://github.com/ismaelsoilet/jev-harness # source🇧🇷 Resumo
Execuções verdes nunca bloqueiam (detector determinístico com no_failure, zero chamadas de API), hook de pre-commit funcional com console entry point, init --git que detecta o runner, ficheiros de estado 0600/0700, e documentação completa de acesso a provedores com data de verificação e regra de re-checagem a cada 30 dias. 207 testes, 100% de aprovação.
Full Changelog: v0.1.11...v0.1.12
v0.1.11 — Tri-runtime heuristic parity, .jev.json precedence & release gate hardening
⚡ v0.1.11 — Tri-runtime heuristic parity, .jev.json precedence & release gate hardening
Frontier model registry re-verified by web research on September 22, 2026 (GPT-6 Astra, Claude Fable 5.1, DeepSeek V4.1-Flash/Pro, Qwen 3.8 Max, Gemini 3.8 Flash Thinking, Kimi-k3, MiMo-v2.6-pro).
🐛 Fixed
- Tri-runtime classification parity (TypeScript) — an explicit assertion now scores identically in Python, TypeScript and Rust. The
rules/04precedence case (FAILplus a cross-lineExpected:/Received:pair containing a module name) isdeep_logic/skip_llm=falseon every runtime again. - Cross-line assertions —
Expected:/Received:pairs spanning lines are detected through a bounded 300-character window with mandatory colons, so ordinary prose (expected response not received) can never suppress a transient classification. - Bare exceptions no longer mask root causes —
RuntimeError: ... Caused by: ModuleNotFoundErrorisenv_missing, timeouts stayflaky_transient, and busy ports (already in use,Port 8080 is already in use,Failed to start server: ...) are retried deterministically. FAIL/FAILEDword boundaries —failing tests:andfailsafe modeare no longer mistaken for assertion lines. Rust mirrors the Python/TypeScript lookahead with two anchored regexes, because theregexcrate has no lookahead support.
⚙️ Configuration and resilience
.jev.jsonhonored end-to-end in Python, TypeScript and Rust:model,skip_llm_thresholdandabort_threshold, with clamping to[0, 1], corrupted-file tolerance, and thejev-latestscaffold placeholder treated as "use the provider default".- No more auth crashes in CI — HTTP
401/403from any provider degrades to offline simulation with a stderr warning andis_mock=true; other errors still surface. - Honest ROI metrics — savings counters are labeled as heuristic estimates, the assumption model is printed, and
--jsonexposesestimates_are_heuristic. - OpenRouter documented as alpha — it requires approved access; the endpoint and the
typesafe/jev-1.13model are not publicly listed.
🚦 Release engineering
release.ymlnow requires the full CI matrix (Linux/macOS/Windows × Python 3.9-3.13, Node 18-22, Rust) through a reusable-workflow gate before publishing to PyPI, npm or crates.io.verify-syncnow fails when user-agent or MCP server version literals drift from the manifest version.- Zero
cargo clippywarnings;actionlintclean.
🧪 Verification
197 tests, 100% passing — 107 Python, 47 Rust, 43 TypeScript. Independently re-verified through adversarial review; two review findings were reproduced, fixed and re-checked.
📦 Install
pip install jev-harness==0.1.11 # Python (PyPI)
npm install @ismaelsoilet/jev-harness@0.1.11 # TypeScript / Node (npm)
cargo add jev-harness@0.1.11 # Rust (crates.io)
git clone https://github.com/ismaelsoilet/jev-harness # source🇧🇷 Resumo
Paridade tri-runtime nas heurísticas, .jev.json honrado de ponta a ponta, fallback gracioso em falhas de autenticação (401/403), métricas de ROI rotuladas como estimativa e gate de CI completo antes de publicar. 197 testes, 100% de aprovação.
Full Changelog: v0.1.10...v0.1.11
Release v0.1.10
🌟 Jev Harness v0.1.10: Native Rust MCP Server, Concurrency Lock & Tri-Runtime Contract Parity
🚀 Highlights
- 🛡️ Native Rust MCP Server (
packages/rust/src/mcp.rs): High-performance JSON-RPC 2.0 stdio MCP server for the Rust crate (jev mcp/jev-harness mcp), providing full feature parity with Python and TypeScript across all 6 semantic decision gates. - ⚡ Atomic Concurrency File Locking (
fcntl.flock): Robust transactional file locking insession.pyguaranteeing zero metric corruption and 0.0% counter data loss under heavy concurrent agent executions. - 🔄 OpenCode Zen Live Auth Fallback: Automatic graceful fallback to offline heuristic simulation on HTTP 401/403 when community dummy/zen keys are used, eliminating unhandled crashes in production.
- 🛠️ CLI Subcommands Unification (
init&metrics): Full cross-runtime availability ofinit(repo scaffolding & agent adapter generation) andmetrics(session ROI and token telemetry) across Python, TypeScript, and Rust. - 📐 Rigid JSON Schema & Contract Parity: Ensured dual availability of
action_recommendation+recommendationandreasoning_summary+summaryacross all CLI--jsonoutputs and MCP tool invocations. - 🧪 149-Test Battery: 100% test pass rate across 149 tests (86 Python, 34 Rust, 29 TypeScript) with sub-100µs latency in Rust.
📦 Quad-Sync Registries
- GitHub: https://github.com/ismaelsoilet/jev-harness/releases/tag/v0.1.10
- PyPI: https://pypi.org/project/jev-harness/
- npm: https://www.npmjs.com/package/@ismaelsoilet/jev-harness
- Crates.io: https://crates.io/crates/jev-harness
Full Changelog: v0.1.9...v0.1.10
v0.1.9 — Command Code Free Provider & Continuation Nudge Gate (Jev Nudge)
Release v0.1.9: Native Command Code Free Provider (provider=commandcode, https://api.commandcode.ai/provider/v1/systemone, model typesafe/jev) and 6th Semantic Decision Gate (should_nudge_continuation / CLI nudge-gate / MCP tool jev_should_nudge_continuation) with gated workflow phases (research, ask, plan, execute, verify, complete) and calibrated Noul probabilities across Python (84 tests), TypeScript (29 tests), and Rust (32 tests) — 145/145 tests passing.
Release v0.1.8
🌟 Key Highlights in v0.1.8
-
🏛️ Astra-Ares v0.2.1 Protocol Parity:
openrouternative endpoint:https://openrouter.ai/api/alpha/decisions(typesafe/jev-1.13,provider: { only: ["typesafe"], allow_fallbacks: false }).vercelnative endpoint:https://ai-gateway.vercel.sh/v1/evaluate(typesafe-ai/jev,providerOptions: { gateway: { only: ["typesafe-ai"] } }, supportingVERCEL_API_KEY,AI_GATEWAY_API_KEY, andVERCEL_AI_GATEWAY_API_KEY).typesafedirect endpoint:https://api.typesafe.ai/v1/systemone(jev-latest).opencodezen endpoint:https://opencode.ai/zen/v1/systemone(jev-1.13-free).
-
⚡ 8-Level Reasoning Scale & Provider Dialects:
- Full support for
none,minimal,low,medium,high,xhigh,max,ultraviasupported_efforts/supportedEfforts. - Dialect compiling with clean CoT disable mapping (
none/minimal) for DeepSeek (extra_body.thinking.type: disabled), Qwen (enable_thinking: false), Anthropic (thinking.type: disabled), Kimi (extra_body.thinking: false), and MiMo (thinking.type: disabled).
- Full support for
-
🔄 Multi-Generation Effort Leasing:
- Parallel evaluation of
lease(1,2,5,10steps) respectingmax_lease_stepswith safe clamping (max_lease_steps >= 1). - Returns
lease_steps = 5for mechanical steps,lease_steps = 1for error states/tracebacks, andlease_steps = 2for standard tasks.
- Parallel evaluation of
-
🔒 Zero-Trust Secret Redaction:
- Automatic masking (
[REDACTED]) ofBearer ...,sk-...,vck_..., and active API keys in all HTTP error messages and diagnostics across Python, TypeScript, and Rust.
- Automatic masking (
-
🌐 Polyglot & Multilingual Semantic Parity:
- Exact semantic categorization across 9 programming languages: Python, TypeScript/Node, Rust, Go, Java, C#, Ruby, C++ ->
env_missing(skip_llm = true) vsdeep_logic(skip_llm = false). - Multilingual evaluation parity across English, Portuguese (PT-BR), and Spanish (ES).
- Exact semantic categorization across 9 programming languages: Python, TypeScript/Node, Rust, Go, Java, C#, Ruby, C++ ->
-
🛡️ Red-Team Defense Hardening:
- Collision resistance in
verify_step_completionandshould_abort_trajectory. - Prompt injection resistance in
modulate_reasoning_effort.
- Collision resistance in
-
🔌 CLI & MCP Tooling Evolution:
- CLI binaries across Python, TypeScript, and Rust accept
--supported-effortsand--max-lease-steps. - Native MCP servers expose updated tool schemas and return
lease_stepsin JSON responses.
- CLI binaries across Python, TypeScript, and Rust accept
-
🧪 Expanded 138-Test Battery:
- 100% test pass rate across 138 tests (79 Python, 31 Rust, 28 TypeScript) with Rust latency p99 < 90µs.
Full Changelog: v0.1.7...v0.1.8
Release v0.1.7
⚡ Jev Harness v0.1.7 Release Notes
Zero-dependency System One decision harness, token optimizer, and semantic guardrails for AI coding agents.
🌟 Highlights & Key Enhancements
- 📊 Empirical Tri-Runtime Latency Benchmarks (< 500µs Guarantee): Added comprehensive empirical latency benchmark tables (
$p50$ ,$p95$ ,$p99 < 500\mu\text{s}$ ) across Python, TypeScript, and Rust, verified with 1,000-iteration automated test suites. - ⚡ Rust Engine Optimization: Cached static regexes with
std::sync::LazyLockand optimized zero-allocation fallback client references in gates, dropping Rust triage$p99$ to 37.5µs and pure System One simulation to 1.3µs. - 🛠️ TypeScript CLI & Native MCP Full Parity: Hardened Unix semantic exit code handling (code
2on missing command or invalid arguments) and added dual camelCase + snake_case JSON field support across CLI commands and native MCP tools (skip_llm,should_abort,provider_params,is_reasoning_supported). - 🚀 In-Memory Heuristic Acceleration: Added
record_session: bool = Falseflag to decouple memory-only gate calls from filesystem I/O, achieving sub-150µs$p99$ latency in Python while preserving full telemetry on CLI executions. - 🧪 Complete 123-Test Battery: 100% test pass rate across 123 tests (73 Python, 26 Rust, 24 TypeScript) with zero compiler warnings.
- 🔧 Release & Wiki Tooling: Enhanced
scripts/release.shto automatically synchronize TS MCP server version, AGENTS constitutions, and modular rules. Addedscripts/push_wiki.shandscripts/push_wiki.ps1.
📦 Official Registries & Artifacts
- GitHub: https://github.com/ismaelsoilet/jev-harness/releases/tag/v0.1.7
- PyPI (Python): https://pypi.org/project/jev-harness/0.1.7/
- npm (TypeScript/Node): https://www.npmjs.com/package/@ismaelsoilet/jev-harness/v/0.1.7
- Crates.io (Rust): https://crates.io/crates/jev-harness/0.1.7
Full Changelog: v0.1.6...v0.1.7
v0.1.6: AGENTS Constitution, Modular Rules & 2026 Frontier Governance
🏛️ Jev Harness v0.1.6 — AGENTS Constitution, Modular Rules & 2026 Frontier Governance
📜 Master Architecture & AGENTS Constitution
AGENTS.mdRoot Entrypoint: Established the master constitution and architectural blueprint that all autonomous AI coding agents (OpenCode, Cursor, Claude Code, Antigravity IDE, Windsurf, Zed, Pi) must read before executing tasks.- Modular Engineering Rules (
.agents/rules/):01_project_blueprint.md: Full architectural map, directory structure, Daniel Kahneman System 1 vs. System 2 cognitive duality, and tri-runtime parity.02_software_engineering_principles.md: Karpathy LLM coding principles, Fable method, Unix pipe philosophy, and anti-Frankenstein design (zero reverse-proxy instability).03_model_governance_and_frontier_registry.md: Active web research mandate, explicit research provenance dates, KV cache hysteresis, and direct model safeguards.04_testing_and_truthfulness.md: Zero-trust posture, 109-test distribution, and strict prohibition of paper-tiger assertions.05_release_and_quad_sync_protocol.md: 6-step release checklist, automated pre-push verification, and post-release monitoring across all 4 registries.06_code_style_and_conventions.md: Strict conventions for Python (zero runtime deps, stdlib only), TypeScript (pure ESM, zero deps), and Rust (Tokio 2021).
🌐 Strict 2026 Frontier Model Governance
- Mandatory Web Research with Verified Date Stamps: All frontier model references are verified via active web research with formal provenance recording (Pesquisa realizada em 22 de setembro de 2026).
- Anthropic Flagship Normalization:
- Officially released active flagships:
Claude Opus 5(released July 24, 2026) andClaude Fable 5.1(released September 1, 2026). - Unreleased version projections (e.g. 5.2 / 5.5) strictly prohibited from being documented as available.
- Officially released active flagships:
- 2026 Multi-Dialect Reasoning Compiler: Native payload generation for
gpt-6-astra,o3-mini,deepseek-v4.1-flash,deepseek-v4-pro,qwen-3.8-max(2.4T MoE),gemini-3.8-flash-thinking,kimi-k3, and Xiaomimimo-v2.6-pro.
🔒 Mandatory Pre-Push Parity & Registry Protection
- Automated Pre-Push Hook (
.git/hooks/pre-push): Strictly intercepts and blocks anygit pushif versions differ acrosspyproject.toml,package.json,Cargo.toml, and__init__.py. - CI Parity Verification (
ci.yml): Continuous integration checks manifest parity on all PRs and pushes via./scripts/release.sh --verify-sync. - Prohibition of Orphan Bumps: Eliminates version discrepancies between code manifests, git tags, and release notes.
📦 Quad-Registry Synchronized Availability
- GitHub: Tagged
v0.1.6onmainbranch - PyPI (Python):
pip install jev-harness==0.1.6 - npm (TypeScript):
npm install @ismaelsoilet/jev-harness@0.1.6(Sigstore OIDC provenance) - Crates.io (Rust):
cargo add jev-harness@0.1.6
🧪 Quality & Evidence
- 109 Tests Passing (100% Pass Rate):
- Python: 68 tests (
python3 -m unittest discover tests -v) - Rust: 23 tests (
cargo test --manifest-path packages/rust/Cargo.toml) - TypeScript: 18 tests (
npm test --prefix packages/ts)
- Python: 68 tests (