Skip to content

v3.4.0

Choose a tag to compare

@alikahwaji alikahwaji released this 04 Nov 09:31
· 97 commits to main since this release
0ccf236

A minor release with no breaking changes. An optional LLM judge closes the paraphrase gap in the answer check, and a new package serves a folder of documents to Claude and other MCP clients.

npm install @devilsdev/rag-pipeline-utils@^3.4.0

Highlights

  • An LLM judge for paraphrases. checkAnswer({ answer, sources, judge }) asks any LLM with this library's generate() contract about the sentences that failed for lack of shared words, such as a correct paraphrase. It never overturns a wrong number or a negation, a "supported" verdict must name a source that passes those checks, and unparseable output keeps the sentence unsupported. Without judge, nothing changes and no model is called. The LLM judge
  • The judge in the AI SDK middleware. groundingMiddleware({ retriever, judge }) adds the verdicts to providerMetadata.ragPipeline.judge for generateText and streamText. A judge that throws doesn't fail the call. Middleware
  • @devilsdev/rag-mcp-server. npx @devilsdev/rag-mcp-server ./docs indexes a folder of Markdown, HTML, CSV and text files offline and serves search_documents and check_answer to Claude, Cursor or any MCP client. No API key or database. MCP server
  • A short npm page. The package page on npmjs.com is now about 110 lines; the full README stays on GitHub.

Also

The scoped packages (@devilsdev/rag-core, -connectors, -eval, -guardrails) are released at 3.4.0 too, and @devilsdev/rag-mcp-server is new at 3.4.0. Full details: CHANGELOG · Blog post