Skip to content

Improving the issue auto-labeling #750

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 4 commits into from
Nov 26, 2025
Merged

Improving the issue auto-labeling #750

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
4 commits
Select commit Hold shift + click to select a range
8eb49fa
Mentioning tests does not mean test plans area
nikolapeja6 Nov 26, 2025
3e2b3a7
Setting the issue type as well
nikolapeja6 Nov 26, 2025
d1b9f64
Revert "Setting the issue type as well"
nikolapeja6 Nov 26, 2025
cf0c320
Adding the "Needs Review 👓" label by default
nikolapeja6 Nov 26, 2025
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
6 changes: 5 additions & 1 deletion .github/ai-automation/ai-issue-processing-system-prompt.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -68,4 +68,8 @@ The `labels` array should contain strings representing the recommended label nam
- Do not make assumptions beyond what is clearly stated or strongly implied
- Ensure all recommended labels are meaningful and actionable
- If uncertain about a label, exclude it rather than guessing
- An issue may have multiple type labels and multiple area labels if appropriate

## [📌] Additional Guidelines

- Issues may warrant multiple type labels and/or multiple area labels when clearly justified by the content
- **Test Plans Label Usage**: Only apply `Test Plans 🧪` when the issue directly relates to test management features, test case authoring, test suites, or the Test Plans API itself—not merely because testing or writing tests is mentioned as part of standard development practice
6 changes: 3 additions & 3 deletions .github/workflows/ai-issue-processing.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -39,9 +39,9 @@ jobs:
# Parse the JSON response to extract labels
LABELS=$(echo "$AI_RESPONSE" | python3 -c "import sys, json; print(' '.join([f'--add-label \"{label}\"' for label in json.load(sys.stdin)['labels']]))")

# Add the recommended labels and remove the ai-issue-processing label
# Add the recommended labels, always add "Needs Review 👓", and remove the ai-issue-processing label
if [ -n "$LABELS" ]; then
eval gh issue edit $ISSUE_NUMBER $LABELS --remove-label "ai-issue-processing" --repo ${{ github.repository }}
eval gh issue edit $ISSUE_NUMBER $LABELS --add-label "Needs Review 👓" --remove-label "ai-issue-processing" --repo ${{ github.repository }}
else
gh issue edit $ISSUE_NUMBER --remove-label "ai-issue-processing" --repo ${{ github.repository }}
gh issue edit $ISSUE_NUMBER --add-label "Needs Review 👓" --remove-label "ai-issue-processing" --repo ${{ github.repository }}
fi