feat: Outpost skill & examples, scenario-tester evals, and event-gateway CLI guidance#20
Merged
Merged
Conversation
- Add full-stack Next.js and FastAPI+React reference apps under skills/outpost/examples - Add integration maps under skills/outpost/references for progressive disclosure - Extend outpost SKILL.md with example pointers and testing notes - Wire test-examples.sh and GitHub Actions for outpost SaaS examples - Document outpost example testing in TESTING.md and CONTRIBUTING.md - Adjust .gitignore for example lockfiles and artifacts Made-with: Cursor
…piVersion in seed Align seed script Stripe client with the apiVersion expected by the installed stripe package. Made-with: Cursor
- Lazy Stripe client; STRIPE_MOCK=1 and dev catalog mock without secret key - Guard checkout callback and webhook when Stripe is disabled - Document STRIPE_MOCK and no-key dev behavior in .env.example and README Made-with: Cursor
When adding a hookdeck destination, show steps and a new-tab link to dashboard.hookdeck.com/connect for obtaining the connection token. Made-with: Cursor
- SKILL: maps-first, reference-only examples, stack snapshot, API Access note - Integration maps: transfer patterns to user repo; manifest pointers - CONTRIBUTING: sync SKILL snapshot when bumping Outpost examples - TESTING: note STRIPE_MOCK=1 for next build - fastapi-saas: outpost_sdk >=1.0.0,<2 Made-with: Cursor
Update Outpost skill guidance to use hookdeck.com/docs/outpost as the single source of truth, surface llms.txt and language quickstarts first, and trim in-file operational detail so agents choose the smallest successful path faster. Also correct supported destination claims (Kafka supported, EventBridge planned), fix reference links after section renames, and keep managed/self-hosted API pointers consistent with current docs. Made-with: Cursor
leggetter
changed the title
Revert accidental inclusion of local agent-scenario-tester changes so this PR stays scoped to Outpost skill and documentation updates. Made-with: Cursor
- Document hookdeck gateway as default for Event Gateway; deprecate root connection - Collapse metrics table to match actual CLI (queue/issue views via measures) - Cross-link hookdeck umbrella skill to gateway command model Made-with: Cursor
Made-with: Cursor
…bric - Add optional --judge / RUN_LLM_JUDGE (Anthropic Messages API); write llm-score.json and append to report.md. - Load repo-root .env before commands; add .env.example for required env vars. - Support skillUnderTest per scenario (event-gateway, outpost, hookdeck); add outpost-managed-quickstart and tighten receive-webhooks Stage 01 (human hookdeck.com/docs/cli URL without .md, or install commands). - Include generated source/config in judge transcript; pass framework into judge pipeline. - Update TESTING.md, scenario script header, and agent-scenario-tester README; add dotenv and @types/js-yaml. Made-with: Cursor
…e READMEs - Add canonical Hookdeck CLI prerequisite in cli-workflows.md; link from SKILL and stage references with short preambles. - Example READMEs document official install (hookdeck.com/docs/cli#installation) and brew/npm commands instead of skill-internal paths. Made-with: Cursor
- Prefer https://console.hookdeck.com for throwaway webhook URLs; forbid fake hookdeck.com/webhook paths; avoid webhook.site by default (SKILL, scope, verify, nextjs-saas README). - Replace PostHog progressive-disclosure links with neutral guidance in SKILL and integration maps. Made-with: Cursor
leggetter
changed the title
Replace the outdated MCP roadmap with shipped CLI MCP (beta): operational query/inspect scope, correct hookdeck gateway mcp entrypoint, and links to human-facing docs (/docs/mcp and /docs/cli). Document in AGENTS.md that root README must not use hookdeck.com .../*.md URLs. Made-with: Cursor
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
Outpost skill (original PR scope)
skills/outpost/references/.skills/outpost/SKILL.mdto usehttps://hookdeck.com/docs/outpostas the single source of truth, prioritizellms.txtplus curl / TypeScript / Python / Go quickstarts, and add explicit fast-path guidance for agents.Additional changes (stacked on this branch)
--judge/RUN_LLM_JUDGE), load repo-root.env(see.env.example),skillUnderTestplusoutpost-managed-quickstartscenario, judge transcript includes generated source/config on disk, and a stricter Stage 01 rubric (human-facinghttps://hookdeck.com/docs/cliURL without.md, or an explicit CLI install command).TESTING.mdandtools/agent-scenario-tester/README.mdupdated.references/cli-workflows.md; SKILL and stage references link to it with short preambles. Example READMEs document official install (hookdeck.com/docs/cli#installation) and brew / npm commands for humans.https://hookdeck.com/webhook/createor generic echo sites (e.g.webhook.site) by default;scenarios.yamlprompt foroutpost-managed-quickstartaligned. Removed PostHog cross-links from skill and integration maps in favor of neutral wording.Validation
./scripts/test-agent-scenario.sh run receive-webhooks express --judgeandrun outpost-managed-quickstart express --judge(heuristic + judge artifacts verified).overview,api,llms.txt, language quickstarts, CLI install).