Skip to content

ci(security-review): drop sticky comment, post workflow summary, re-enable synchronize#1293

Merged
tejaskash merged 4 commits into
mainfrom
security-review-smoketest
May 18, 2026
Merged

ci(security-review): drop sticky comment, post workflow summary, re-enable synchronize#1293
tejaskash merged 4 commits into
mainfrom
security-review-smoketest

Conversation

@tejaskash
Copy link
Copy Markdown
Contributor

@tejaskash tejaskash commented May 18, 2026

Summary

Tiny doc tweak to test the new Claude Security Review workflow end-to-end now that #1285 has merged.

Adds a one-sentence note in CONTRIBUTING.md noting that the manual workflow_dispatch path can verify analysis but cannot post inline comments — the action's inline-comment MCP server only attaches on PR-context events.

Test plan

  • Verify the Claude Security Review workflow runs automatically on this PR (maintainer-authored → opens via pull_request_target).
  • Confirm the bot posts inline review comments via the mcp__github_inline_comment__create_inline_comment tool, OR posts a "no findings" summary via mcp__github_comment__update_claude_comment if there's nothing to flag on a docs-only diff.
  • Confirm OIDC role assumption to GitHubActions-ClaudeSecurityReview succeeds.

@tejaskash tejaskash requested a review from a team May 18, 2026 20:19
@github-actions github-actions Bot added size/xs PR size: XS agentcore-harness-reviewing AgentCore Harness review in progress claude-security-reviewing Claude Code /security-review in progress labels May 18, 2026
@github-actions
Copy link
Copy Markdown
Contributor

Package Tarball

aws-agentcore-0.14.0.tgz

How to install

npm install https://github.com/aws/agentcore-cli/releases/download/pr-1293-tarball/aws-agentcore-0.14.0.tgz

@github-actions github-actions Bot removed the claude-security-reviewing Claude Code /security-review in progress label May 18, 2026
Copy link
Copy Markdown

@agentcore-cli-automation agentcore-cli-automation left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Docs-only smoke-test PR — looks good to merge.

The added note in CONTRIBUTING.md is accurate: it matches the workflow_dispatch input description in .github/workflows/pr-security-review.yml ("workflow_dispatch will NOT post inline comments — the action only attaches the inline-comment MCP server on PR-context events"). Single sentence, right section, no code/test/telemetry implications. ✅

@github-actions github-actions Bot removed the agentcore-harness-reviewing AgentCore Harness review in progress label May 18, 2026
@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 18, 2026

Coverage Report

Status Category Percentage Covered / Total
🔵 Lines 43.52% 9179 / 21090
🔵 Statements 42.78% 9739 / 22763
🔵 Functions 40.33% 1588 / 3937
🔵 Branches 40.31% 5974 / 14818
Generated in workflow #3082 for commit 2d88076 by the Vitest Coverage Report Action

…mmary

Three changes to verify the inline-comment posting path end-to-end:

1. Add scripts/__sec_review_smoketest.mjs with two deliberate security
   findings (hardcoded AWS credentials, command injection via exec) so
   create_inline_comment is actually exercised.
2. Remove instructions to call mcp__github_comment__update_claude_comment
   from the prompt. That tool requires CLAUDE_COMMENT_ID, which the action
   only sets in tag mode / when track_progress is enabled. In agent mode it
   fails. Drop the corresponding entry from --allowedTools too.
3. Add a workflow step that counts buffered findings and posts a single
   top-level summary comment via the GitHub App token regardless of
   findings. Replaces the broken sticky-comment path.
@github-actions github-actions Bot added size/m PR size: M and removed size/xs PR size: XS labels May 18, 2026
Comment thread scripts/__sec_review_smoketest.mjs Fixed
@github-actions github-actions Bot added size/m PR size: M and removed size/m PR size: M labels May 18, 2026
@github-actions github-actions Bot added the claude-security-reviewing Claude Code /security-review in progress label May 18, 2026
@agentcore-devx-automation
Copy link
Copy Markdown
Contributor

Claude Security Review: no high-confidence findings. (run)

@github-actions github-actions Bot removed the claude-security-reviewing Claude Code /security-review in progress label May 18, 2026
…ch run)

The deliberate findings file was added to exercise the inline-comment posting
path. The workflow_dispatch run confirmed the bot correctly identifies both
findings (hardcoded AWS credentials, command injection via exec). End-to-end
posting via mcp__github_inline_comment__create_inline_comment can only be
verified once this PR merges and a follow-up PR triggers pull_request_target
— workflow_dispatch produces an AutomationContext where the inline-comment
MCP server doesn't register.
@github-actions github-actions Bot added size/s PR size: S and removed size/m PR size: M labels May 18, 2026
@tejaskash tejaskash changed the title docs: clarify workflow_dispatch limitation for security review ci(security-review): drop sticky comment, post workflow summary, re-enable synchronize May 18, 2026
Copy link
Copy Markdown
Contributor

@notgitika notgitika left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@github-actions github-actions Bot added the claude-security-reviewing Claude Code /security-review in progress label May 18, 2026
@agentcore-devx-automation
Copy link
Copy Markdown
Contributor

Claude Security Review: no high-confidence findings. (run)

@github-actions github-actions Bot removed the claude-security-reviewing Claude Code /security-review in progress label May 18, 2026
@tejaskash tejaskash merged commit fcbdf59 into main May 18, 2026
30 checks passed
@tejaskash tejaskash deleted the security-review-smoketest branch May 18, 2026 21:10
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

size/s PR size: S

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants