Skip to content

agentdrill v0.1.0

Latest
Latest

Choose a tag to compare

View all tags
@deghosal-2026 deghosal-2026 released this 25 Oct 21:53
· 2 commits to main since this release
v0.1.0
7622f25

Changes

7622f25 ci(m32): make publish-pypi idempotent with an explicit pre-check
735b79c ci(m32): make the release pipeline re-runnable + green
7ddef08 ci(m32): grant attestations: write so the release attest step can run
28a821d feat(m32): publish v0.1.0 to PyPI + record evidence (32.10)
98525db docs(m32): traceability for the final milestone set + R79 artifact
ec05023 docs(m32): record M32 code-review findings #216-#220
257887e docs(m32): PyPI download + verification instructions across the docs
efddc10 docs(wbs): add M32 32.10 PyPI publish + verification (issue #394)
29564bc feat(m32): independent artifact verification (32.4)
050c10f docs(m32): publish the compatibility matrix with declared gaps (32.7)
f6b85ca feat(m32): compatibility dataset + AWC generator (adoption half of 32.7)
b7fb6e0 docs(m32): record first-run evidence (timed clean-machine quickstart)
2cd604b docs(m32): audit and fix all docs (status, links, ADRs, release notes)
0cd5a43 docs(m32): publish the v0.1.0 compliance matrix (mappings + gaps + evidence index)
f6dbc16 docs(m32): publish the v0.1.0 security audit (0 unresolved findings)
1ca25ec docs(m32): versioning + backwards-compat policy normative; version-consistency test
0e4887c feat(m32): release tooling — SBOM + checksums + provenance; make release-dry-run green
489d5e1 chore(m32): harden the secrets scan (no token/secret leakage)
c3fddb6 test(m31): milestone gate + harness regression tests (I-1..I-11); close M31
7612df2 feat(m31): FT-E25 cross-OS parity wired (100%) + Track B fully re-earned — full pass 73/73
29715ed docs(m31): fix CUJ table, consistency issues in field test report
aef8f26 feat(m31): wire verify CLI + run --dry-run; 3 declared tests now PASS
e91cb67 field tests changes
6dc984d docs(m31): field-test report — full sweep complete, 69 PASS / 0 FAIL, deep-verified
4faf0f1 field tests changes
05ef534 field tests changes
f511145 field tests changes
51e8c20 field tests changes
dc5db79 field tests changes
ab0ce09 field tests changes
03466ba field tests changes
1c59e57 docs(m31): field-test report — full-run findings, deep verification, root causes
543b0ab field tests changes
1d15f08 field tests changes
b892bc3 field tests changes
9aece91 test(m31): run Track C field batch — 5/5 PASS, deep-verified; fill report
fe80414 feat(m31): field-test harness — docker setup, runs, deep verification (31.1)
59b66f9 docs(m31): field-test report template (agentwatch v0.2.0 format)
25cae23 docs(m31): field-test plan of record — suites, runbook, success measures
ca533ee docs(m30): reference, review + milestone closure (30.T/C/L/CR/D)
be31ec2 feat(m30): standards participation (30.7)
af415a1 feat(m30): master standards table + pins + evidence index (30.6)
3df6832 feat(m30): standards claims linter (30.5)
00eb0f2 feat(m30): version-follow SLA + drivers (30.4)
81ef283 feat(m30): compatibility levels + matrix (30.3)
95576c9 feat(m30): trace explorer analysis + a11y/inert/load gates (30.2)
6c4cb4e feat(m30): trace explorer core (30.1)
bfdc853 docs(m29): reference, review + milestone closure (29.T/C/L/CR/D)
34572d6 feat(m29): frontier classes 2, 3 & AP2 stub (29.7)
abbaee3 feat(m29): frontier classes 7 & 6 - denial-of-wallet + multi-agent cascade (29.6)
9172878 feat(m29): frontier classes 1 & 5 - approval abuse + memory/persistence (29.5)
8affc89 feat(m29): frontier class 4 - identity, delegation & OAuth (29.4)
8b65807 feat(m29): public corpus import (29.3)
8a433d3 feat(m29): Break-It program (29.2)
517750a feat(m29): extension detonation lab (29.1)
7a9ec7b docs(m29,m30): execution plans + milestone records (start M29, M30)
5e1a9a0 docs(m28): reference, review + milestone closure (28.T/C/L/CR/D)
b123fdf feat(m28): safe-fire interlocks (28.7)
3a65ebc feat(m28): rules of engagement - signed RoE + fail-closed preflight (28.6)
48a27fd feat(m28): attestation freshness + consumers (28.5)
c83fbaf feat(m28): drill attestation - in-toto predicate + signing (28.4)
d22a775 feat(m28): ledger exports - OSCAL + SARIF + tickets (28.3)
b844580 feat(m28): time-boxed waivers (28.2)
f631672 feat(m28): finding lifecycle + exposure ledger (28.1)
cece7ac docs(m28): execution plan + milestone record (start M28)
69f90c6 docs(m27): reference, review + milestone closure (27.T/C/L/CR/D)
b4258e8 feat(m27): incident-to-pack compiler (27.6)
5893711 feat(m27): structural findings + path status (27.5)
25f09f5 feat(m27): capability/attack-path graph (27.4)
4910eea feat(m27): trace->drill promotion (27.3)
62ce068 feat(m27): shadow mode + false-block budget (27.2)
ca0c630 feat(m27): trace backtest (27.1)
b34acae docs(m27): execution plan + milestone record (start M27)
bfe3ce2 docs(m26): reference, review + milestone closure (26.T/C/L/CR/D)
f983392 feat(m26): reliability — retries, DLQ spool, signed webhooks (26.7)
26e94a8 feat(m26): SIEM/EDR detection validation (26.6)
f18b67a feat(m26): inbound import from Inspect/promptfoo/garak/AgentDojo/PyRIT (26.5)
61177bc feat(m26): CI/code-scanning + ticketing adapters (26.4)
ff76541 feat(m26): OCSF/ECS + OSCAL + STIX emitters (26.3)
7d575ae feat(m26): OTel emit/read for drills (26.2)
e32af64 feat(m26): SARIF + JUnit emitters (26.1)
6ecabf0 docs(m26): execution plan + milestone record (start M26)
87c92a8 docs(wbs): index progress header — M0–M25 complete, M26–M32 not started
89181c7 docs(m25): byod/neutrality docs, code review, milestone checkpoint (25.D/25.CR)
7e8fffa feat(m25): neutrality process (25.5)
d3737d6 feat(m25): neutral head-to-head (25.4)
28e7960 feat(m25): defense zoo (25.3)
e9d3bf1 feat(m25): conformance kit (25.2)
89f3ee9 feat(m25): defense contract + SDK (25.1)
81e867e docs(m24): attacker-strength docs, code review, milestone checkpoint (24.D/24.CR)
29a1d59 feat(m24): search coverage report (24.8)
e398cfb feat(m24): minimization + dedup + promotion (24.7)
a4b8023 feat(m24): bounded search engine (24.6)
a8ccd41 feat(m24): route-family library (24.5)
339e6c8 feat(m24): Hold@k CI gate (24.4)
3465d97 feat(m24): pressure curves + claim scope (24.3)
96b7bf4 feat(m24): Hold@k / ASR@k metrics (24.2)
bff208f feat(m24): attacker tiers (24.1)
b210b4a docs(m23): effect-witness/lab docs, code review, milestone checkpoint (23.D/23.CR)
e926e7e feat(m23): lab isolation + ground truth (23.8)
2b3db1e feat(m23): poisoned content corpus (23.7)
ff41cbb feat(m23): adversary lab core (23.6)
6470d5a feat(m23): two-oracle verdict (23.5)
156e1f0 feat(m23): side-effect ledger + human-surface (23.4)
dbd82bf feat(m23): credential + process witnesses (23.3)
a924faf feat(m23): FS + network witnesses (23.2)
4c2d6bc feat(m23): effect declarations (23.1)
83d91c2 docs(m22): hardening docs, code review, milestone checkpoint (22.D/22.CR)
b001490 feat(m22): self-observability run summary (22.6)
d16f2ec feat(m22): cost controls (22.5)
262d77c feat(m22): portability (22.4)
327e331 feat(m22): untrusted-pack hardening (22.3)
ea97670 feat(m22): fault injection & fail-closed (22.2)
78d5d05 feat(m22): performance & scale (22.1)
dc275f0 docs(m21): parity/gap-closure docs, code review, milestone checkpoint (21.D/21.CR)
3342e3f feat(m21): predecessor retention plan (21.4)
54c3611 feat(m21): parity gate (21.3)
1c672e1 feat(m21): predecessor gap closure G1-G14 (21.2)
6c9fd03 feat(m21): absorption ledger verification (21.1)
27319c1 docs(m20): frontier/DX docs, code review, milestone checkpoint (20.D/20.CR)
dd64343 feat(m20): fleet mode (20.8)
e5ebe7c feat(m20): read-only MCP drill surface (20.7)
b58969d feat(m20): provenance cards (20.6)
0f84bf3 feat(m20): programmatic assertions (20.5)
b933cdf feat(m20): CI-matrix export (20.4)
bcb22a6 feat(m20): pack templates (20.3)
8f2214a feat(m20): pack diff + coverage delta (20.1)
dadce8c docs(m19): oracle-credibility docs, code review, milestone checkpoint (19.D/19.CR)
5bc6a37 feat(m19): dispute process (19.7)
30ca529 feat(m19): oracle honesty labels (19.6)
397e4da feat(m19): human adjudication layer (19.5)
054c175 feat(m19): oracle meta-eval battery (19.4)
374d273 feat(m19): judge drift detection (19.3)
7f1c38c feat(m19): calibration corpus (19.2)
871bf5e feat(m19): oracle versioning + release notes (19.1)
5f0063c docs(m18): lifecycle docs, code review, milestone checkpoint (18.D/18.CR)
02fb0de feat(m18): closes-the-loop policy suggestion (18.9)
441c830 feat(m18): MCP + memory pack classes (18.8)
b06b062 feat(m18): quickstart + demo stack (18.7)
cabc948 feat(m18): evidence privacy with receipts (18.6)
b72f2a1 feat(m18): standalone bundle verifier (18.5)
3056a37 feat(m18): target attestation gate (18.4)
7982c27 feat(m18): seam probing (18.3)
c36e530 feat(m18): remediation validation (18.2)
7712bd1 feat(m18): incident-intake pipeline (18.1)
293b92c docs(m17): interop docs, code review, milestone checkpoint (17.D/17.CR)
ca8b329 feat(m17): competitor honest-coverage benchmark (17.6)
b4e38bd feat(m17): standards submission + OSS-Fuzz pack class (17.5)
ee607e2 feat(m17): compliance-mapped reporting (17.4)
ce147db feat(m17): adversary profiles (17.3)
5a85b2e feat(m17): standards tagging + lint gate (17.2)
2ddf37b feat(m17): interop importer (17.1)
8c3aeb9 docs(m16): registry docs, code review, milestone checkpoint (16.D/16.CR)
3b215a3 feat(m16): registry sync + pack outdated (16.6)
8325435 feat(m16): deprecation + takedown on a signature chain (16.5)
af0ec7d feat(m16): contribution flow lint + review gate (16.4)
e6f6c09 feat(m16): trust-level enforcement (16.3)
e1ab08b feat(m16): signing + verified publishers (16.2)
232b629 feat(m16): content-addressed signed registry index (16.1)
6bdafff docs(m15): chain/adaptive docs, code review, milestone checkpoint (15.D/15.CR)
1f48fcc feat(m15): registry review gate (15.5)
7facaa6 feat(m15): adaptive determinism (15.4)
8fea003 feat(m15): bounded adaptive orchestrator (15.3)
8b5096c feat(m15): chain break-point reporting (15.2)
e6341ea feat(m15): chain structure + step runner (15.1)
7ec53c7 docs(m14): self-attack docs, code review, milestone checkpoint (14.D/14.CR)
d0ded9d feat(m14): hidden adversarial case (14.5)
9ca4af4 feat(m14): CI cadence for self-attack suites (14.4)
e741187 feat(m14): dark holdout (14.3)
8011f40 feat(m14): drill-the-drill meta-verification (14.2)
12fbc83 feat(m14): evasion / self-attack pack (14.1)
4129493 docs(m13): efficacy docs, code review, milestone checkpoint (13.D/13.CR)
fbf78c4 feat(m13): efficacy report artifact (13.5)
351d179 feat(m13): per-case cleanup + dirty_target (13.4)
9ce4e4f feat(m13): utility-under-attack (13.3)
014d2d4 feat(m13): inert-attack flagging (13.2)
7a42b0d feat(m13): efficacy control against an unguarded twin (13.1)
41d873a docs(m12): kill-chain docs, code review, milestone checkpoint (12.D/12.CR)
9e450b2 feat(m12): evidence for the cessation probe (12.6)
5076fab feat(m12): kill-time budgets published in policy (12.5)
cb75301 feat(m12): kill-chain timeline findings (12.4)
97d550b feat(m12): per-stage kill-time percentiles (12.3)
bccdb2f feat(m12): cessation probe (12.2)
e5311e6 feat(m12): kill-chain stage model + timeline (12.1)
151df59 docs(m11): CI docs, code review, milestone checkpoint (11.D/11.CR)
e9989ba feat(m11): scheduled drills (11.8)
519b629 feat(m11): PR annotations + webhook alerts (11.7)
57e65c6 feat(m11): diff-aware re-run selection (11.6)
93cef32 feat(m11): local watch mode (11.5)
cfa3302 feat(m11): trigger watcher / CART (11.4)
0914586 feat(m11): CI output for GitHub Actions / GitLab (11.3)
3136ac9 feat(m11): dimension + divergence gating (11.2)
1277199 feat(m11): run exit codes for the CI gate (11.1)
14ed785 docs(m10): reporting docs, code review, milestone checkpoint (10.D/10.CR)
cf339a4 feat(m10): benchmark publisher + submission bundle (10.9)
bcec473 feat(m10): trend store across releases (10.8)
941b83b feat(m10): traces per benchmark row (10.7)
d3ad3bb feat(m10): coverage heat-map (10.6)
fa69095 feat(m10): severity rubric, attack-class x exposure (10.5)
85be246 feat(m10): bootstrap confidence intervals on rates (10.4)
632b5ee feat(m10): multi-seed statistical rigor (10.3)
524a6d2 feat(m10): honest report — misses mandatory (10.2)
9decf8d feat(m10): multi-format report renderer (10.1)
ffadc84 docs(m9): comparison design docs, code review, milestone checkpoint (9.D/9.CR)
cf67135 feat(m9): golden/preregistration store (9.6)
41edee7 feat(m9): three-way outcome classification (9.5)
af9d718 feat(m9): flip attribution with mechanism + confidence (9.4)
bf98048 feat(m9): change detection — swaps are not regressions (9.3)
25d4b43 feat(m9): attack comparison engine, case/tag/aggregate deltas (9.2)
ef6b422 feat(m9): golden expected results + golden-lock (9.1)
75095b9 docs(m8): design/reference docs, code review, milestone checkpoint (8.D/8.CR)
c8bf77a docs(m8): deterministic oracle methodology (8.6)
fe7b337 feat(m8): reproducibility check for pinned attack runs (8.5)
acd783d feat(m8): contamination checks for cases vs training posture (8.4)
9fa601d feat(m8): pin seeds/models/pack-hash/oracle versions (8.3)
de7ea0f feat(m8): emit run-manifest.json for attack runs (8.2)
e74937f feat(m8): record/replay fixtures for driver responses (8.1)
07e0f08 feat(m7): evidence integration
dae5e2f feat(m6): oracle engine
e39af46 feat(m5): target adapters & recon/scoping
09cd095 feat(m4): driver adapters
308baaa feat(m3): runner & execution spine
2ad2c36 docs(m2): record M2 checkpoint in the WBS index
4e11c7b feat(m2): attack-pack format, loader, resolution, catalog & hashing
935e5ec feat(m2): add canonical attack-pack schema (2.1)
866fc6d chore(m33): prefix repo to agentsec-* and update references (#392)
8613e71 docs: update org references to agentic-suite (#391)
6862cd9 Merge feature/v0.1.0 into main (M0 + M1) (#385)
8185b48 docs: v0.1.0 world-class additions (PRDs 25-43, WBS M23-M32, designs/plans/standards) (#384)
a34785e docs: add v0.1.0 requirements, design, WBS, reference and repo scaffolding (#287)
ddbe3dd Add DCO and OpenSSF Scorecard workflows + badge (#1)
2bef37f Customize README for agentdrill
8660f24 Initial commit

What's Changed

New Contributors

Full Changelog: https://github.com/agentic-suite/agentsec-agentdrill/commits/v0.1.0

Contributors

deghosal-2026
Assets 7
Loading