Skip to content

v0.35.0

Choose a tag to compare

@github-actions github-actions released this 11 Nov 09:16
· 10 commits to main since this release
0e94db7

What's Changed

  • ci(mcp): check our own MCP server with plune mcp lint and check by @AZANIR in #197
  • docs(mcp): name a server that exits before initialize in the check exit codes by @AZANIR in #198
  • test(mcp-testing): an enum that is not a list is not classified by @AZANIR in #199
  • feat(eval): repeat rows with runs and pass_threshold by @AZANIR in #200
  • feat(mcp): plune mcp conformance: catalog, MUST-only score, frozen profile by @AZANIR in #201
  • feat(config): an mcp block in plune.yaml for agentic evals by @AZANIR in #202
  • feat(mcp): run the protocol checks of plune mcp conformance by @AZANIR in #203
  • fix(mcp): logging and completion checks are SHOULD; the JSON-RPC error checks are derived by @AZANIR in #204
  • feat(mcp): the tool loop of an agentic eval, with a transcript per row by @AZANIR in #205
  • feat(assertions): tool-call checks over the transcript of an agentic eval by @AZANIR in #206
  • chore(release): 0.35.0 by @AZANIR in #208

Full Changelog: v0.34.6...v0.35.0