Skip to content

[WIP] Audit AIC usage for workflows from 2026-08-06 - #50844

Merged
pelikhan merged 4 commits into
mainfrom
copilot/agentic-token-audit-2026-08-06
Aug 6, 2026
Merged

[WIP] Audit AIC usage for workflows from 2026-08-06#50844
pelikhan merged 4 commits into
mainfrom
copilot/agentic-token-audit-2026-08-06

Conversation

Copilot AI commented Aug 6, 2026

Copy link
Copy Markdown
Contributor
  • Investigate the failing Daily VulnHunter Scan run (31077438828) — it consumed 1028.56 AIC, exceeding the default max-ai-credits: 1000 budget and failing
  • Prune the VulnHunter bundle deterministically in the vulnhunter_bundle job (only the vulnhunt skill, source-only repo snapshot) — bundle shrinks from 375 MB / 6,693 files to 21 MB / 1,786 files
  • Precompute a ranked high-risk candidate file list (scope/candidates.txt, 40 files) so the agent never explores the tree
  • Tighten the prompt to a bounded, budget-aware scan plan with pinned phase files
  • Add turn/timeout guardrails (max-turns: 40, timeout-minutes: 30) without raising max-ai-credits
  • Recompile the lock file, shellcheck the generated bundle step, and run it end-to-end locally
  • Verify the daily rotation window produces no duplicates or gaps across all list sizes and all 366 days
  • Address code review: revert an unrelated .github/skills/agentic-workflows/SKILL.md edit that referenced a non-existent file

Copilot AI and others added 3 commits August 6, 2026 12:28
Co-authored-by: pelikhan <4175913+pelikhan@users.noreply.github.com>
Co-authored-by: pelikhan <4175913+pelikhan@users.noreply.github.com>
Co-authored-by: pelikhan <4175913+pelikhan@users.noreply.github.com>
Copilot AI requested a review from pelikhan August 6, 2026 12:45
@pelikhan
pelikhan marked this pull request as ready for review August 6, 2026 15:07
Copilot AI balanced review requested due to automatic review settings August 6, 2026 15:07
@pelikhan
pelikhan merged commit 11d47c4 into main Aug 6, 2026
@pelikhan
pelikhan deleted the copilot/agentic-token-audit-2026-08-06 branch August 6, 2026 15:07

Copilot AI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

Reduces Daily VulnHunter Scan AIC usage through deterministic scoping and tighter execution limits.

Changes:

  • Builds a smaller source-only bundle with ranked candidates.
  • Pins scan phases and adds turn/timeout limits.
  • Regenerates the compiled workflow.
Show a summary per file
File Description
.github/workflows/daily-vulnhunter-scan.md Adds bounded bundle preparation and scan instructions.
.github/workflows/daily-vulnhunter-scan.lock.yml Compiles the updated workflow configuration.

Review details

Tip

Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

  • Files reviewed: 2/2 changed files
  • Comments generated: 3
  • Review effort level: Balanced

Comment on lines +53 to +55
find "$REPO_ROOT" -type f \
\( -name '*_test.go' -o -name '*.test.cjs' -o -name '*.test.js' -o -name '*.test.ts' \) \
-delete
Comment on lines +164 to +166
2. Read `/tmp/gh-aw/agent/vulnhunter/vulnhunt/SKILL.md` for the methodology. Apply it as a
**single agent**: ignore its orchestrator/sub-agent dispatch machinery and its Phase 1
recon instructions, which the bundle job already replaced.
Comment on lines +167 to +169
3. Read exactly these two phase files and no others:
- `/tmp/gh-aw/agent/vulnhunter/vulnhunt/phases/phase2_class_inj.md`
- `/tmp/gh-aw/agent/vulnhunter/vulnhunt/phases/phase2b_verify.md`
@github-actions

github-actions Bot commented Aug 7, 2026

Copy link
Copy Markdown
Contributor

🎉 This pull request is included in a new release.

Release: v0.86.0

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

[agentic-token-audit] 2026-08-06 - AIC Usage Audit

3 participants