Skip to content

docs: add key principles and API schema workflow to agent guidance#466

Merged
BYK merged 1 commit intomainfrom
byk/improve-agent-skill-guidance
Mar 18, 2026
Merged

docs: add key principles and API schema workflow to agent guidance#466
BYK merged 1 commit intomainfrom
byk/improve-agent-skill-guidance

Conversation

@BYK
Copy link
Member

@BYK BYK commented Mar 18, 2026

LLM agents loading the sentry-cli skill were resorting to downloading OpenAPI
schemas from GitHub instead of using CLI commands like sentry issue view CLI-G5.
The SKILL.md was a pure command reference with no guidance on when to use which
command.

Changes

docs/src/content/docs/agent-guidance.md

  • Added a "Key Principles" section (before "Design Principles") instructing agents to
    always use CLI commands directly, use sentry schema for API exploration, and use
    sentry issue view <id> for investigating issues
  • Added an "Explore the API Schema" workflow pattern
  • Added a "Downloading API schemas externally" common mistake entry

docs/src/content/docs/agentic-usage.md

  • Added concrete command mappings for common questions
  • Added self-containment note about using CLI commands over external schemas

plugins/sentry-cli/skills/sentry-cli/SKILL.md

  • Regenerated to include the new guidance sections

@github-actions
Copy link
Contributor

github-actions bot commented Mar 18, 2026

Semver Impact of This PR

🟢 Patch (bug fixes)

📋 Changelog Preview

This is how your changes will appear in the changelog.
Entries from this PR are highlighted with a left border (blockquote style).


New Features ✨

  • (span) Make span list dual-mode and add --period flag by BYK in #461
  • Refactor SKILL.md into modular reference files by BYK in #458

Bug Fixes 🐛

  • (test) Use os.tmpdir() for test temp directories by BYK in #457
  • Make piped output human-readable instead of raw CommonMark by BYK in #462
  • Clean up upgrade output and hide empty table headers by BYK in #459
  • Improve error messages — fix ContextError/ResolutionError misuse by BYK in #456

Documentation 📚

  • Add key principles and API schema workflow to agent guidance by BYK in #466

Internal Changes 🔧

  • (list) Align all list commands to issue list standards by BYK in #453

🤖 This preview updates automatically when you update the PR.

@github-actions
Copy link
Contributor

github-actions bot commented Mar 18, 2026

PR Preview Action v1.8.1

QR code for preview link

🚀 View preview at
https://cli.sentry.dev/pr-preview/pr-466/

Built to branch gh-pages at 2026-03-18 21:35 UTC.
Preview will be ready when the GitHub Pages deployment is complete.

@BYK BYK marked this pull request as ready for review March 18, 2026 20:49
@github-actions
Copy link
Contributor

github-actions bot commented Mar 18, 2026

Codecov Results 📊

116 passed | Total: 116 | Pass Rate: 100% | Execution Time: 0ms

📊 Comparison with Base Branch

Metric Change
Total Tests
Passed Tests
Failed Tests
Skipped Tests

✨ No test changes detected

All tests are passing successfully.

✅ Patch coverage is 100.00%. Project has 1130 uncovered lines.
✅ Project coverage is 95.3%. Comparing base (base) to head (head).

Coverage diff
@@            Coverage Diff             @@
##          main       #PR       +/-##
==========================================
+ Coverage    95.30%    95.30%        —%
==========================================
  Files          177       177         —
  Lines        24067     24067         —
  Branches         0         0         —
==========================================
+ Hits         22937     22937         —
- Misses        1130      1130         —
- Partials         0         0         —

Generated by Codecov Action

Add a 'Key Principles' section to agent-guidance.md that explicitly
instructs LLM agents to:
- Always use CLI commands directly, never download external schemas
- Use 'sentry schema' for API exploration instead of fetching OpenAPI files
- Use 'sentry issue view <id>' to investigate specific issues

Add an 'Explore the API Schema' workflow pattern showing how to use
'sentry schema' for API discovery.

Add a common mistake entry about downloading API schemas externally.

Update agentic-usage.md with concrete command mappings for common
questions and a self-containment note.

Regenerate SKILL.md to include the new guidance sections.
@BYK BYK force-pushed the byk/improve-agent-skill-guidance branch from 2203e84 to fa39097 Compare March 18, 2026 21:34
@BYK BYK merged commit 12304c9 into main Mar 18, 2026
23 checks passed
@BYK BYK deleted the byk/improve-agent-skill-guidance branch March 18, 2026 21:38
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant