Skip to content

evals: v1.1.0

Choose a tag to compare

View all tags
@github-actions github-actions released this 21 Aug 06:23
evals@vv1.1.0
816e9cf
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Verified
Learn about vigilant mode.

1.1.0 (2026-08-21)

🚀 Features & Verification Engines

  • core: complete audit remediation and health monitoring suite (b2b73c5)
  • evals: add unbiased 100-vector adversarial stress testbed and engine hardenings (ca6fd34)
  • evals: implement academic benchmark suites (InjecAgent, AgentDojo, MCP-Bench), CLI eval runner, and scientific whitepaper (5a9f5d8)
  • evals: implement research-grade double-blind evaluation, dynamic TAP fuzzer, and UK AISI Inspect AI adapter (b2f777a)
  • evals: ingest academic benchmarks and add ed25519 merkle verification (0532c7e)
  • frontier: 10-subagent comprehensive hardening across AST security, polyglot parity, benchmarks, and latency SLAs (bab8d7c)
  • governance: signed rule packs (AISVS C10.1.1) + fail-closed policy lifecycle — cycle 6 (484f6d6)
  • grc: Drata & Vanta continuous compliance connector and UK AISI Inspect AI AgentHarm expansion (31f10fb)
  • provenance+trajectory: IFC-001 information-flow control & Mann-Kendall trajectory stress — research-aligned cycle 5 (7bc37bc)
  • red-team: 'aegis red-team run' + FIX real PII layered-evasion bypass found on first live fire (600c538)
  • release: Aegis Invariant Kernel v1.0.0 (Production Core, Adapters, Python SDK, Cloud Gateway, & Compliance Packs) (8beb76a)
  • scientific-rigor: CIs on every claim, ablation study, metamorphic properties — 2 more real engine gaps found & fixed (1630105)
  • sdk: full go and rust engines, academic benchmark adapters, cpa verification, and hybrid bridge (0dbc20b)
  • verify: complete elite verification harness — fast-check property tests, 433-vector fuzz corpus, 100% mutation score, regression gates, and build concurrency cap (969a0ed)

🐛 Bug Fixes & Invariant Patches

  • ci: resolve all 5 GitHub Actions workflow failures — WASM assertion, benchmark tolerance, gitleaks ignore, Docker concurrency, nightly audit (94ca910)
  • cli: ensure zero-dependency standalone CLI bundling and complete Inspect AI wiring (ec3df67)
  • cli: resolve unused filePath parameter, yaml.load method, and add JIT warmup in trajectory-stress (980677e)
  • evals: calibrate trajectory stress drift tolerance for CI virtual machines (51f7d91)
  • evals: clean up unused types and enforce circular reference & prototype pollution defenses (73df037)
  • security: sanitize dummy secret test tokens and enforce least-privilege token permissions across CI workflows (d89b675)

⚡ Performance & AST Optimizations

  • optimize ledger disk persistence and calibrate CI performance bounds (ba0ca70)

📚 Documentation & Compliance

  • formalize academic bibliography and dataset fair-use attribution (b166aaa)

🧪 Invariant Tests & Fuzzing

  • calibrate CI timing bounds in engine.test.ts and tricky-100.test.ts (61dec00)
Assets 2
Loading