Fix CLI consistency checker pre-agent help bootstrap to fail fast on empty datasets

[Copilot]

The CLI Consistency Checker’s pre-agent bootstrap was repeatedly producing Pre-collected help lines: 0, forcing the agent to rebuild and re-collect help during execution and burning significant AIC/time before analysis. This change makes help collection deterministic and surfaces bootstrap failures directly in CI.

• Pre-agent help capture reliability

  • Capture gh-aw --help output with 2>&1 so command metadata is consistently written to main.txt for parsing.

• Fail-fast guard: command extraction

  • Add an explicit hard-fail when zero top-level commands are parsed from main.txt, instead of continuing into a silent empty-state path.

• Fail-fast guard: aggregate dataset integrity

  • After concatenating help files into /tmp/gh-aw/agent/all-help.txt, fail if the file exists but is empty.

• Compiled workflow sync

  • Recompiled cli-consistency-checker.lock.yml to reflect the updated pre-agent shell block.

./gh-aw --help > "${output_dir}/main.txt" 2>&1
mapfile -t top_commands < <(awk "${extract_commands}" "${output_dir}/main.txt" | sort -u)
if [ ${#top_commands[@]} -eq 0 ]; then
  echo "No top-level commands were parsed from ./gh-aw --help output" >&2
  exit 1
fi

cat "${help_files[@]}" > /tmp/gh-aw/agent/all-help.txt
if [ ! -s /tmp/gh-aw/agent/all-help.txt ]; then
  echo "Combined help output is empty" >&2
  exit 1
fi

• Fixes [agentic-token-optimizer] CLI Consistency Checker: fix broken pre-agent help-collection step wasting ~110 AIC/run #49369

[Copilot]

Pull request overview

Fixes CLI help pre-collection so bootstrap failures surface before agent execution.

Changes:

• Captures root help from stderr.
• Adds extraction and aggregate-data guards.
• Regenerates the compiled workflow.

Show a summary per file

File	Description
.github/workflows/cli-consistency-checker.md	Updates help collection and validation.
.github/workflows/cli-consistency-checker.lock.yml	Synchronizes compiled workflow output.

Review details

Tip

Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

• Files reviewed: 2/2 changed files
• Comments generated: 1
• Review effort level: Balanced

[github-actions]

🎉 This pull request is included in a new release.

Release: v0.84.2