Add collect tools and Breeze API fixture for feedback testing#3
Merged
Conversation
mme
force-pushed
the
mme/fixtures-plus-collect
branch
from
0b1aaff to
7279d41
Compare
mme
force-pushed
the
mme/fixtures-plus-collect
branch
from
7279d41 to
54e6e36
Compare
Adds a collect tool to both Breeze fixture configs so agents can report whether search results were accurate. Updates the search tool description to prompt agents to submit feedback after using results.
- Use tool object (not toolType var) in exhaustive switch default - Remove unused intermediate type variable in server dispatch - Remove redundant blank line in collect tool - Remove backwards-compat config defaulting tests (covered by schema) - Improve MCP request logging with type-aware formatting - Simplify claude npm script variable naming - Fix README search tools header casing
mme
force-pushed
the
mme/fixtures-plus-collect
branch
from
54e6e36 to
6759dd4
Compare
…tests
- index.ts: fix shutdown catch to suppress both PGlite ("not initialized")
and pg ("DATABASE_URL") expected errors instead of only the latter
- source-indexer.ts: throw instead of returning silently when local source
path doesn't exist, so orchestrator records status: 'error'
- source-indexer.ts: clarify computeLocalSha JSDoc (uses mtimes, not content)
- orchestrator.ts: fix isStale JSDoc to say "configured threshold" not "24h"
- tool-config.test.ts: restore backwards-compat defaulting tests
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
2 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
npm run fixture:breeze-api) with correct and intentionally-broken documentation variants, for testing agent behavior when docs mislead.DATABASE_URL=pglite:///pathso fixtures run without Docker.npm run claude: launches Claude Code in an isolated temp directory wired to the local MCP server.Testing it
Three terminals:
Then ask the agent: "Get the weather in Berlin"
The agent will search the (broken) docs, try the wrong endpoint/method, fail, and should submit feedback via
submit-breeze-feedback. Swap terminal 2 fornpm run fixture:breeze-docsto compare with correct docs.Test plan
npm test— unit tests for collect tool schema conversion, MCP protocol, and config validation🤖 Generated with Claude Code