Skip to content

feat: add multi-metric trend release gates - #7

Merged
brandonwise merged 1 commit into
mainfrom
auto/pm-presence-20260429
Apr 30, 2026
Merged

feat: add multi-metric trend release gates#7
brandonwise merged 1 commit into
mainfrom
auto/pm-presence-20260429

Conversation

@brandonwise

Copy link
Copy Markdown
Owner

Summary

  • extend argate trend beyond pass-rate drift to also report average latency, p95 latency, and average cost trends across historical runs
  • keep existing --fail-on-regression behavior pass-rate-only for backward compatibility, while adding explicit metric gate flags for latency, p95, cost, and any regression
  • persist p95_latency_ms in recorded history and ignore malformed/non-run JSON files in history directories so trend output does not poison later analyses
  • document the new trend workflow and add focused CLI/history coverage

Why now

Validation

  • python3 -m pytest tests/test_history.py tests/test_cli.py ✅ (16 passed)
  • python3 -m pytest ✅ (27 passed)
  • python3 -m pip install . ✅ (wheel/install succeeded locally; host pip 21.2.4 emitted legacy warnings)
  • python3 -m compileall src
  • PYTHONPATH=src python3 -m agent_release_gate.cli evaluate --spec examples/spec.yaml --results examples/results.json --output "$TMP_DIR/gate-report.json" --markdown "$TMP_DIR/gate-report.md" --record-history "$TMP_DIR/history" ✅ smoke run, gate passed, recorded p95_latency_ms=920.0
  • PYTHONPATH=src python3 -m agent_release_gate.cli trend --history "$TMP_DIR" --fail-on-latency-regression > "$TMP_DIR-output.json" ✅ smoke run, exited 1 with avg_latency_regression=true, p95_latency_regression=true, avg_cost_regression=true
  • node /Users/bwise/.openclaw/workspace/projects/humanizer/src/cli.js analyze -f README.md --ignore-code --json ✅ humanizer score 1, high-confidence, no significant AI-writing patterns detected

Risk / rollback

  • Low risk, additive CLI surface only
  • Roll back by reverting commit 5022edf

@brandonwise
brandonwise merged commit 9b6e2fe into main Apr 30, 2026
2 checks passed
@brandonwise
brandonwise deleted the auto/pm-presence-20260429 branch April 30, 2026 01:26
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant