[UPDATE PROMPTS] Add agent skills for creating and publishing CodeQL model packs#48
Draft
[UPDATE PROMPTS] Add agent skills for creating and publishing CodeQL model packs#48
Conversation
Agent-Logs-Url: https://github.com/advanced-security/codeql-development-template/sessions/06f6941a-2548-4b45-a89a-e2000c394848 Co-authored-by: data-douser <70299490+data-douser@users.noreply.github.com>
Agent-Logs-Url: https://github.com/advanced-security/codeql-development-template/sessions/06f6941a-2548-4b45-a89a-e2000c394848 Co-authored-by: data-douser <70299490+data-douser@users.noreply.github.com>
Copilot
AI
changed the title
[WIP] Add agent skills for creating and publishing CodeQL model packs
[UPDATE PROMPTS] Add agent skills for creating and publishing CodeQL model packs
Apr 22, 2026
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Adds two
SKILL.mdfiles under.github/skills/that turn the existing models-as-data reference docs into procedural, agent-routable workflows for the two distinct deployment paths: repo-local extensions vs. GHCR-published model packs.📝 Prompt Update
.github/skills/resource type).github/prompts/*.prompt.md), procedurally oriented rather than reference-oriented🎯 Changes
What Changed
.github/skills/create-model-pack/SKILL.md— numbered procedure: identify library/language → classify API intosourceModel/sinkModel/summaryModel/barrierModel/barrierGuardModel/typeModel/neutralModel→ choose between.github/codeql/extensions/(noqlpack.yml) and a reusable pack underlanguages/<lang>/custom/src/→ author.model.ymlwith the right tuple format → wireqlpack.ymlextensionTargets/dataExtensions→ validate viacodeql query run --additional-packs=…andcodeql test run --additional-packs=…..github/skills/publish-model-pack/SKILL.md— numbered procedure: verifyqlpack.yml(name,version,library: true,extensionTargets,dataExtensions) →codeql pack create→codeql pack publish(withGITHUB_TOKEN/packages: writenotes) → configure under org Code security → Global settings → CodeQL analysis → Model packs → semver bump strategy with auto-latest behavior for Default Setup → validate via Analyze workflow logs.name+ agent-routingdescription,When to use,Prerequisites,Procedure,Validation checklist,Related resources), cross-link each other, and link out to the existingdata_extensions_development.prompt.md, language-specific data extension prompts, andresources/cli/codeql/*.prompt.mdfiles rather than duplicating tuple-format and CLI reference content.Why This Change
The data extension prompts are excellent reference material (tuple formats, threat models, access path syntax) but are not structured as action plans. Skills routed by
descriptiongive agents — especially Copilot Cloud Agent — a step-by-step recipe and cleanly separate the "no publish needed" repo-local path from the "publish to GHCR + configure org Default Setup" path, which today are intermingled in the reference docs.Issues Addressed
Agents jumping straight to YAML authoring without first deciding deployment scope, skipping local validation with
--additional-packs, conflatingcodeql query run(supports--model-packs) withcodeql test run(does not), and missing theqlpack.yml→ org settings → workflow-log validation chain when publishing.🔍 Impact
Previous Behavior
When asked to "model library X" or "publish a model pack", agents had only reference prompts to draw on and tended to produce YAML without the surrounding workflow (scope decision,
qlpack.ymlglob verification, local query/test runs, GHCR publish, org configuration, log-based validation).New Behavior
Agent routing on the skill
descriptiontriggers the matching skill, and the agent executes the numbered Procedure end-to-end, deferring to the linked reference prompts only for tuple-format and CLI detail.🧪 Validation
Test Scenarios
*.mdoverride,printWidth: 100,proseWrap: preserve); YAML frontmatter parses withname+descriptionfields populated.parallel_validation(Code Review + CodeQL) reports no findings.📋 Checklist
PROMPTS.mddoes not currently describe.github/skills/; consider a follow-up to add the new resource type to the hierarchy diagram🔗 References
Note: This update maintains hierarchy integrity and follows prompt system best practices.