Skip to content

Add code skills#28420

Open
harshach wants to merge 1 commit into
mainfrom
new_skills
Open

Add code skills#28420
harshach wants to merge 1 commit into
mainfrom
new_skills

Conversation

@harshach
Copy link
Copy Markdown
Collaborator

@harshach harshach commented May 26, 2026

Describe your changes:

Fixes #

I worked on ... because ...

Type of change:

  • Bug fix
  • Improvement
  • New feature
  • Breaking change (fix or feature that would cause existing functionality to not work as expected)
  • Documentation

High-level design:

N/A — small change.

Tests:

Use cases covered

Unit tests

Backend integration tests

Ingestion integration tests

Playwright (UI) tests

Manual testing performed

UI screen recording / screenshots:

Not applicable.

Checklist:

  • I have read the CONTRIBUTING document.
  • My PR title is Fixes <issue-number>: <short explanation>
  • My PR is linked to a GitHub issue via Fixes #<issue-number> above.
  • I have commented on my code, particularly in hard-to-understand areas.
  • For JSON Schema changes: I updated the migration scripts or explained why it is not needed.
  • For UI changes: I attached a screen recording and/or screenshots above.
  • I have added tests (unit / integration / Playwright as applicable) and listed them above.

Summary by Gitar

  • New agent skills:
    • Added 15 specialized skills for automated development, including diagnose for debugging, tdd for test-driven development, and triage for issue management.
    • Included utility skills like prototype for quick design iteration and improve-codebase-architecture for structural refactoring.
  • Support documentation:
    • Added configuration templates for issue-tracker and triage-labels to standardize agent interactions.
    • Included reference documentation for domain modeling, ADR formats, and agent brief writing to support autonomous workflows.

This will update automatically on new commits.

Copilot AI review requested due to automatic review settings May 26, 2026 01:42
@github-actions github-actions Bot added backend safe to test Add this label to run secure Github workflows on PRs labels May 26, 2026
Comment on lines +1 to +15
---
name: setup-matt-pocock-skills
description: Sets up an `## Agent skills` block in AGENTS.md/CLAUDE.md and `docs/agents/` so the engineering skills know this repo's issue tracker (GitHub or local markdown), triage label vocabulary, and domain doc layout. Run before first use of `to-issues`, `to-prd`, `triage`, `diagnose`, `tdd`, `improve-codebase-architecture`, or `zoom-out` — or if those skills appear to be missing context about the issue tracker, triage labels, or domain docs.
disable-model-invocation: true
---

# Setup Matt Pocock's Skills

Scaffold the per-repo configuration that the engineering skills assume:

- **Issue tracker** — where issues live (GitHub by default; local markdown is also supported out of the box)
- **Triage labels** — the strings used for the five canonical triage roles
- **Domain docs** — where `CONTEXT.md` and ADRs live, and the consumer rules for reading them

This is a prompt-driven skill, not a deterministic script. Explore, present what you found, confirm with the user, then write.
Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

⚠️ Quality: Generic third-party agent skills added without project customization

This PR adds ~2100 lines of generic agent skill definitions (from what appears to be Matt Pocock's skill framework) to the OpenMetadata repository without any customization for OpenMetadata's domain, conventions, or workflows. The skills reference concepts like CONTEXT.md, AGENTS.md, CLAUDE.md, and workflows (e.g., /setup-matt-pocock-skills) that don't exist in this project. The skill named setup-matt-pocock-skills is particularly incongruous in an OpenMetadata context.

Consider:

  1. Renaming/adapting the setup skill to reference OpenMetadata rather than a third-party author's name.
  2. Pre-configuring docs/agents/domain.md and docs/agents/issue-tracker.md for OpenMetadata's GitHub-based workflow rather than requiring a separate setup step.
  3. Adding a README in .agents/skills/ explaining the purpose of these files and how they relate to OpenMetadata development.
  4. Linking a GitHub issue that explains the motivation and expected usage of these agent skills.

Was this helpful? React with 👍 / 👎


The skills speak in terms of five canonical triage roles. This file maps those roles to the actual label strings used in this repo's issue tracker.

| Label in mattpocock/skills | Label in our tracker | Meaning |
Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

💡 Quality: Triage labels table references wrong source repo name

The triage-labels.md file has a column header "Label in mattpocock/skills" which references an external repository rather than OpenMetadata. This should be renamed to reflect the OpenMetadata project context (e.g., "Canonical role" or "Default label").

Rename the column header to be project-agnostic:

| Canonical role    | Label in our tracker | Meaning                                  |
| ----------------- | -------------------- | ---------------------------------------- |

Was this helpful? React with 👍 / 👎

@gitar-bot
Copy link
Copy Markdown

gitar-bot Bot commented May 26, 2026

Code Review ⚠️ Changes requested 0 resolved / 2 findings

Adds a suite of generic agent skills but requires project-specific customization for the OpenMetadata domain and a fix for the incorrect source repository name in the triage-labels configuration.

⚠️ Quality: Generic third-party agent skills added without project customization

📄 .agents/skills/setup-matt-pocock-skills/SKILL.md:1-15 📄 .agents/skills/setup-matt-pocock-skills/triage-labels.md:5

This PR adds ~2100 lines of generic agent skill definitions (from what appears to be Matt Pocock's skill framework) to the OpenMetadata repository without any customization for OpenMetadata's domain, conventions, or workflows. The skills reference concepts like CONTEXT.md, AGENTS.md, CLAUDE.md, and workflows (e.g., /setup-matt-pocock-skills) that don't exist in this project. The skill named setup-matt-pocock-skills is particularly incongruous in an OpenMetadata context.

Consider:

  1. Renaming/adapting the setup skill to reference OpenMetadata rather than a third-party author's name.
  2. Pre-configuring docs/agents/domain.md and docs/agents/issue-tracker.md for OpenMetadata's GitHub-based workflow rather than requiring a separate setup step.
  3. Adding a README in .agents/skills/ explaining the purpose of these files and how they relate to OpenMetadata development.
  4. Linking a GitHub issue that explains the motivation and expected usage of these agent skills.
💡 Quality: Triage labels table references wrong source repo name

📄 .agents/skills/setup-matt-pocock-skills/triage-labels.md:5

The triage-labels.md file has a column header "Label in mattpocock/skills" which references an external repository rather than OpenMetadata. This should be renamed to reflect the OpenMetadata project context (e.g., "Canonical role" or "Default label").

Rename the column header to be project-agnostic
| Canonical role    | Label in our tracker | Meaning                                  |
| ----------------- | -------------------- | ---------------------------------------- |
🤖 Prompt for agents
Code Review: Adds a suite of generic agent skills but requires project-specific customization for the OpenMetadata domain and a fix for the incorrect source repository name in the triage-labels configuration.

1. ⚠️ Quality: Generic third-party agent skills added without project customization
   Files: .agents/skills/setup-matt-pocock-skills/SKILL.md:1-15, .agents/skills/setup-matt-pocock-skills/triage-labels.md:5

   This PR adds ~2100 lines of generic agent skill definitions (from what appears to be Matt Pocock's skill framework) to the OpenMetadata repository without any customization for OpenMetadata's domain, conventions, or workflows. The skills reference concepts like `CONTEXT.md`, `AGENTS.md`, `CLAUDE.md`, and workflows (e.g., `/setup-matt-pocock-skills`) that don't exist in this project. The skill named `setup-matt-pocock-skills` is particularly incongruous in an OpenMetadata context.
   
   Consider:
   1. Renaming/adapting the setup skill to reference OpenMetadata rather than a third-party author's name.
   2. Pre-configuring `docs/agents/domain.md` and `docs/agents/issue-tracker.md` for OpenMetadata's GitHub-based workflow rather than requiring a separate setup step.
   3. Adding a README in `.agents/skills/` explaining the purpose of these files and how they relate to OpenMetadata development.
   4. Linking a GitHub issue that explains the motivation and expected usage of these agent skills.

2. 💡 Quality: Triage labels table references wrong source repo name
   Files: .agents/skills/setup-matt-pocock-skills/triage-labels.md:5

   The triage-labels.md file has a column header "Label in mattpocock/skills" which references an external repository rather than OpenMetadata. This should be renamed to reflect the OpenMetadata project context (e.g., "Canonical role" or "Default label").

   Fix (Rename the column header to be project-agnostic):
   | Canonical role    | Label in our tracker | Meaning                                  |
   | ----------------- | -------------------- | ---------------------------------------- |

Options

Display: compact → Showing less information.

Comment with these commands to change:

Compact
gitar display:verbose         

Was this helpful? React with 👍 / 👎 | Gitar

Copy link
Copy Markdown
Contributor

Copilot AI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

This PR adds a set of GitHub Copilot agent “skills” under .agents/skills/ to support engineering workflows such as triage, TDD guidance, prototyping, architectural review, diagnosis, and generating PRDs/issues.

Changes:

  • Introduces multiple new agent skills (each with YAML frontmatter + instructions) for planning/triage and engineering execution.
  • Adds supporting reference docs for some skills (e.g., TDD guidance, triage out-of-scope KB format, architecture report scaffold).
  • Adds a HITL (human-in-the-loop) bash loop template for structured bug reproduction.

Reviewed changes

Copilot reviewed 35 out of 35 changed files in this pull request and generated 5 comments.

Show a summary per file
File Description
.agents/skills/zoom-out/SKILL.md Adds a “zoom-out” skill to request higher-level codebase context.
.agents/skills/write-a-skill/SKILL.md Adds guidance/template for authoring new skills.
.agents/skills/triage/SKILL.md Adds a state-machine based issue triage workflow skill.
.agents/skills/triage/OUT-OF-SCOPE.md Documents the .out-of-scope/ knowledge base format/purpose for rejected enhancements.
.agents/skills/triage/AGENT-BRIEF.md Defines a durable “agent brief” template for AFK execution.
.agents/skills/to-prd/SKILL.md Adds a skill to synthesize a PRD and publish it to the issue tracker.
.agents/skills/to-issues/SKILL.md Adds a skill to break a plan/PRD into vertical-slice issues and publish them.
.agents/skills/tdd/SKILL.md Adds TDD process/philosophy guidance as an agent skill.
.agents/skills/tdd/tests.md Adds examples of good vs bad tests (integration-style vs implementation-detail).
.agents/skills/tdd/mocking.md Adds guidelines for mocking at system boundaries.
.agents/skills/tdd/interface-design.md Adds interface-design-for-testability guidance.
.agents/skills/tdd/deep-modules.md Adds “deep modules” concept notes for design/testability.
.agents/skills/tdd/refactoring.md Adds refactor-candidate checklist after TDD cycles.
.agents/skills/setup-matt-pocock-skills/SKILL.md Adds a setup skill to configure issue tracker/labels/domain-doc layout for other skills.
.agents/skills/setup-matt-pocock-skills/triage-labels.md Adds a mapping template between canonical triage roles and repo label strings.
.agents/skills/setup-matt-pocock-skills/issue-tracker-github.md Documents GitHub issue tracker conventions (gh CLI).
.agents/skills/setup-matt-pocock-skills/issue-tracker-gitlab.md Documents GitLab issue tracker conventions (glab CLI).
.agents/skills/setup-matt-pocock-skills/issue-tracker-local.md Documents local-markdown issue tracker conventions.
.agents/skills/setup-matt-pocock-skills/domain.md Documents how skills should consume CONTEXT.md / ADRs.
.agents/skills/prototype/SKILL.md Adds a prototyping skill that routes to logic vs UI prototype flows.
.agents/skills/prototype/LOGIC.md Adds guidance for a terminal-based logic/state prototype shape.
.agents/skills/prototype/UI.md Adds guidance for multi-variant UI prototyping on a route with a switcher.
.agents/skills/improve-codebase-architecture/SKILL.md Adds an architecture-improvement skill focused on “deepening” opportunities and reporting.
.agents/skills/improve-codebase-architecture/LANGUAGE.md Adds canonical vocabulary for architecture suggestions (module/interface/seam/etc.).
.agents/skills/improve-codebase-architecture/DEEPENING.md Adds dependency-category guidance for safe deepening + testing strategy.
.agents/skills/improve-codebase-architecture/INTERFACE-DESIGN.md Adds a parallel sub-agent pattern for comparing alternative interfaces.
.agents/skills/improve-codebase-architecture/HTML-REPORT.md Adds an HTML report scaffold using Tailwind + Mermaid for architecture review output.
.agents/skills/handoff/SKILL.md Adds a skill to write a handoff doc for another agent.
.agents/skills/grill-with-docs/SKILL.md Adds a grilling workflow that updates CONTEXT.md/ADRs inline.
.agents/skills/grill-with-docs/CONTEXT-FORMAT.md Defines the CONTEXT.md glossary format and rules.
.agents/skills/grill-with-docs/ADR-FORMAT.md Defines an ADR format and when to write ADRs.
.agents/skills/grill-me/SKILL.md Adds a lightweight “grill me” interview skill for design stress-testing.
.agents/skills/diagnose/SKILL.md Adds a disciplined diagnosis loop for bugs/perf regressions.
.agents/skills/diagnose/scripts/hitl-loop.template.sh Adds a bash template for a human-in-the-loop repro loop with captured outputs.
.agents/skills/caveman/SKILL.md Adds an ultra-terse “caveman mode” communication skill.

Comment on lines +1 to +4
---
name: zoom-out
description: Tell the agent to zoom out and give broader context or a higher-level perspective. Use when you're unfamiliar with a section of code or need to understand how it fits into the bigger picture.
disable-model-invocation: true

A deep module (as opposed to a shallow module) is one which encapsulates a lot of functionality in a simple, testable interface which rarely changes.

Check with the user that these modules match their expectations. Check with the user which modules they want tests written for.
Comment on lines +16 to +20
2. **Draft the skill** - create:
- SKILL.md with concise instructions
- Additional reference files if content exceeds 500 lines
- Utility scripts if deterministic operations needed

Comment on lines +108 to +114
## Review Checklist

After drafting, verify:

- [ ] Description includes triggers ("Use when...")
- [ ] SKILL.md under 100 lines
- [ ] No time-sensitive info
Comment on lines +13 to +17
<script src="https://cdn.tailwindcss.com"></script>
<script type="module">
import mermaid from "https://cdn.jsdelivr.net/npm/mermaid@11/dist/mermaid.esm.min.mjs";
mermaid.initialize({ startOnLoad: true, theme: "neutral", securityLevel: "loose" });
</script>
@github-actions
Copy link
Copy Markdown
Contributor

🟡 Playwright Results — all passed (9 flaky)

✅ 4248 passed · ❌ 0 failed · 🟡 9 flaky · ⏭️ 87 skipped

Shard Passed Failed Flaky Skipped
✅ Shard 1 299 0 0 4
✅ Shard 2 805 0 0 8
🟡 Shard 3 795 0 1 8
🟡 Shard 4 842 0 3 12
🟡 Shard 5 716 0 3 47
🟡 Shard 6 791 0 2 8
🟡 9 flaky test(s) (passed on retry)
  • Features/RTL.spec.ts › Verify Following widget functionality (shard 3, 1 retry)
  • Pages/CustomProperties.spec.ts › Should search custom properties for apiCollection in right panel (shard 4, 1 retry)
  • Pages/CustomProperties.spec.ts › Time (shard 4, 1 retry)
  • Pages/DataContractsSemanticRules.spec.ts › Validate Description Rule Is_Not_Set (shard 4, 1 retry)
  • Pages/Entity.spec.ts › Inactive Announcement create & delete (shard 5, 1 retry)
  • Pages/Entity.spec.ts › Inactive Announcement create & delete (shard 5, 1 retry)
  • Pages/ExplorePageRightPanel_KnowledgeCenter.spec.ts › Should remove glossary term for knowledgeCenter (shard 5, 1 retry)
  • Pages/Lineage/LineageFilters.spec.ts › Verify lineage schema filter selection (shard 6, 1 retry)
  • Pages/ServiceListing.spec.ts › should render the service listing page (shard 6, 1 retry)

📦 Download artifacts

How to debug locally
# Download playwright-test-results-<shard> artifact and unzip
npx playwright show-trace path/to/trace.zip    # view trace

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

backend safe to test Add this label to run secure Github workflows on PRs

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants