Skip to content

ci: add AI-powered issue triage for auto-classifying new issues#469

Merged
longbinlai merged 4 commits into
mainfrom
ci/issue-triage
Jun 3, 2026
Merged

ci: add AI-powered issue triage for auto-classifying new issues#469
longbinlai merged 4 commits into
mainfrom
ci/issue-triage

Conversation

@longbinlai

Copy link
Copy Markdown
Collaborator

Summary

  • Add a GitHub Actions workflow that auto-classifies new issues into umbrella parent issues using Qwen LLM (DashScope API)
  • Shadow mode only: posts a suggestion comment, never auto-links sub-issues
  • Silently skips when DASHSCOPE_API_KEY secret is not configured — no error, no comment, no impact on issue creation
  • Gracefully handles API failures — logs and exits cleanly

Files

  • .github/workflows/issue-triage.yml — workflow triggered on issues: [opened, edited]
  • .github/scripts/triage_issue.py — classifier script (Qwen via OpenAI-compatible endpoint)
  • .github/issue-triage-config.yml — umbrella scope definitions (scope_in / scope_out)

Validation

Activation

After merge, add DASHSCOPE_API_KEY in repo Settings → Secrets → Actions. Without the secret, the workflow is a no-op.

🤖 Generated with Claude Code

Uses Qwen (qwen3-max) via DashScope to auto-classify new issues into
umbrella parent issues. Shadow mode only — posts a suggestion comment,
never auto-links.

Safety: silently skips when DASHSCOPE_API_KEY is not configured (no
error, no comment). Also catches API call failures gracefully to avoid
affecting issue creation.

Backtest accuracy: 90% (18/20 correct).

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
@longbinlai longbinlai requested a review from lnfjpt June 3, 2026 08:17
longbinlai and others added 3 commits June 3, 2026 16:19
When auto_link_threshold in config is set to "high" or "medium", the
bot will automatically link the issue as a sub-issue of the predicted
umbrella if confidence meets the threshold. Comment text adapts to
indicate whether the link was performed or is just a suggestion.

Currently set to "never" (shadow mode). Change to "high" after
confirming accuracy in production.

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
Change auto_link_threshold from "never" to "high". Bot will now
automatically set parent issue when confidence is high.

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>

@lnfjpt lnfjpt left a comment

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@longbinlai longbinlai merged commit 553fae3 into main Jun 3, 2026
4 checks passed
@longbinlai longbinlai deleted the ci/issue-triage branch June 3, 2026 10:30
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants