[detection-analysis] Detection Analysis Report — 2026-08-11 #52181
Closed
Replies: 1 comment
|
This discussion has been marked as outdated by Detection Analysis Report. A newer discussion is available at Discussion #52384. |
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
Summary
Warning
8 scheduled workflows whose names match audit/report/detector/analyzer keywords do not have
gh-aw-detection: truein their frontmatter.Comparison Chart
Misconfigured Workflows
These are flagged under Rule 2 (name contains audit/analyzer/report/detector/monitor/inspector but lacks
gh-aw-detection: true), verified directly against each workflow's frontmatter in.github/workflows/. All eight run on a daily or weekdayscheduletrigger, so they plausibly executed within the analyzed 24h window even though none of their runs happened to land in this run's log sample (see caveat below —example_run_idis therefore not available for these).daily-action-setup-security-auditgh-aw-detection: truegh-aw-detection: trueto frontmatterdaily-firewall-reportgh-aw-detection: truegh-aw-detection: trueto frontmatterdaily-regression-audit-kirogh-aw-detection: truegh-aw-detection: trueto frontmatterdaily-schema-audit-cursorgh-aw-detection: truegh-aw-detection: trueto frontmatterdaily-sentrux-reportgh-aw-detection: truegh-aw-detection: trueto frontmatterdesigner-drift-auditgh-aw-detection: truegh-aw-detection: trueto frontmattergo-pattern-detectorgh-aw-detection: truegh-aw-detection: trueto frontmatterstatic-analysis-reportgh-aw-detection: truegh-aw-detection: trueto frontmatterNot flagged:
agentic-token-auditmatches the name pattern and also lacksgh-aw-detection: true, but it is a documented, source-managed mirror ofgithubnext/agentic-opsand is excluded per the standing repository opt-out.Excluded from this pass (on-demand only, no schedule, no evidence of running in-window):
objective-impact-report,repo-audit-analyzer,video-analyzer(allworkflow_dispatch-only). Excluded (weekly cadence, unlikely to fall in this specific 24h window):github-mcp-tools-report(Sunday),mcp-inspector(Monday),org-health-report(Monday),ubuntu-image-analyzer(weekly, day unspecified).No violations of Rule 1 (>3 runs/7 days with detection off — insufficient history in a 24h window to assess), Rule 3 (detection steps failing on a detection-enabled run — all 10 detection-enabled runs had empty-but-present
usage/detection/token_usage.jsonl, consistent with normal no-op detection rather than failure), or Rule 4 (alternating detection state within 24h — no workflow in the observed sample ran more than once with differentgh-aw-detectionvalues) were found in the 11-run log sample.View All Run Metrics
Design Decision Gate was the only failure in the sample.
ErrorCount/MissingToolCount/MissingDataCountwere all 0 and the run produced onepush_to_pull_request_branchsafe-output, consistent with the gate intentionally rejecting the PR rather than a technical or detection-related failure.Data-completeness caveat: the pre-downloaded log set at
/tmp/gh-aw/aw-mcp/logs/contained 44 run directories, but only 11 had a populatedaw_info.json/run_summary.json. The other 33 (including this report's own in-flight run,31546135660) were empty — most likely runs still in progress at download time or whose artifacts had not yet been generated/retained. Metrics above reflect only the 11 runs with usable data; they should be read as a sample of the window, not an exhaustive census.View Historical Trend
No trend chart is available yet. This is the first recorded data point in
/tmp/gh-aw/cache-memory/trending/detection/history.jsonl— a trend chart will be generated automatically once at least one more day of history has accumulated.Recommendations
gh-aw-detection: trueto the 8 flagged daily/weekday-scheduled workflows listed above so their AI-credit usage is captured by the detection pipeline like their peers.Design Decision Gate's failure — it appears to be an intentional gate rejection, not a detection or infrastructure fault.References:
All reactions