Prevent tool output in UI

[howdiz]

I’m building a RAG system using the Chat SDK, incorporating ideas from the AI SDK RAG Template.

My goal is for the RAG tool output to be sent directly to the model (for context injection) without rendering in the UI.

Here’s the current tool definition:

export const findRelevantContentTool = tool({
  description: `Fetch relevant knowledge base content to assist with user questions.`,
  parameters: z.object({
    question: z.string().describe("The user's question"),
  }),
  execute: async ({ question }) => {
    const results = await findRelevantContent(question);
    return {
      query: question,
      results: results.map(result => ({
        content: result.content,
        similarity: result.similarity,
        url: result.resourceUrl,
      })),
      found: results.length > 0,
    };
  },
});

I’ve tried approaches like dataStream.writeData and sanitizeResponseMessages to suppress tool output in the UI, but in if the data is not sent to the UI, it’s also not passed to the model.

I’m looking for guidance on how to inject tool output into the model’s context without showing it in the chat UI.

[mediocreaverage1]

Don't return anything.
Or
Don't display the results in the UI.

[howdiz]

Thanks for the reply, @mediocreaverage1.

When I don't return anything, the model does not seem to receive anything.

So it seems I need to handle this filtration closer to the UI.

[github-actions[bot]]

This discussion was automatically locked because it has not been updated in over 30 days. If you still have questions about this topic, please ask us at community.vercel.com/ai-sdk