Skip to content

[Code Quality] Add automatic labeling to smoke test workflows #13413

@github-actions

Description

@github-actions

Description

Smoke test workflows create issues without labels, requiring the auto-triage agent to label them after creation. Adding automatic labeling directly to smoke test workflows would eliminate this extra step.

Current Behavior

From Auto-Triage Reports (2026-02-02, 2026-02-03):

Pattern observed:

  • Smoke test issues created without labels
  • Auto-triage agent processes them later
  • Consistently applies: testing + automation labels
  • 100% of smoke test issues receive these labels

Examples:

Suggested Changes

Update Smoke Test Workflows

Modify smoke test workflows to add labels at issue creation:

# Example: .github/workflows/smoke-copilot.md
safe-outputs:
  create_issue:
    title: "Smoke Test: Copilot - {{run_id}}"
    body: |
      ### Test Summary
      ...
    labels:
      - testing        # Add this
      - automation     # Add this
      - smoke-test     # Consider adding specific label

Files to Update

Likely candidates (search for smoke test workflows):

  • .github/workflows/smoke-copilot*.md
  • .github/workflows/smoke-claude*.md
  • .github/workflows/smoke-project*.md
  • Any other smoke test workflow files

Benefits

  1. Immediate labeling: Issues have correct labels from creation
  2. Reduces auto-triage load: Fewer unlabeled issues to process
  3. Consistency: Labels applied at source, not retroactively
  4. Pattern consistency: Matches recommendation from auto-triage reports

Files Affected

All smoke test workflow files in .github/workflows/:

# Find smoke test workflows
grep -l "Smoke Test" .github/workflows/*.md

Success Criteria

  • All smoke test workflows include labels: in create_issue safe output
  • At minimum: testing and automation labels
  • Consider adding: smoke-test label for easy filtering
  • Auto-triage reports show 0 smoke test issues to process
  • MUST run make recompile after workflow changes
  • MUST run make agent-finish before committing

Implementation Notes

  1. Check if safe-outputs supports labels: parameter in create_issue
  2. If not, this may require updating safe-outputs implementation first
  3. Test with one smoke test workflow before applying to all

Impact

  • Reduces auto-triage processing time
  • Improves issue organization from creation
  • Eliminates delay between issue creation and labeling
  • Follows automation best practices

Source

Extracted from Auto-Triage Report discussions #13331 and #13374 (2026-02-02, 2026-02-03).

Recommendation: "Consider adding automatic labeling to the smoke test workflow itself".

Priority

Low - Process improvement, not blocking functionality (auto-triage handles it currently)

AI generated by Discussion Task Miner - Code Quality Improvement Agent

  • expires on Feb 17, 2026, 5:23 AM UTC

Metadata

Metadata

Assignees

No one assigned

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions