Firefox extension for client-side web search with llama.cpp's webui (and potentially other frontends)

[tbocek]

I built a Firefox extension that intercepts llama.cpp API calls and injects a web_search tool for client-side searching.

Why? Server-side fetching gives you little control - you can't see what's being fetched, solve captchas, or navigate deeper when needed. Client-side search lets you see exactly what content is extracted, you can navigate further, or discard results before sending to the LLM.

How it works:

1. Extension intercepts requests to /v1/chat/completions
2. Injects web_search tool call json into the request
3. When the LLM calls the tool, the extension gets the request, opens DuckDuckGo in a new window
4. Opens each result in a separate tab, extracts content with Readability.js
5. Sends extracted text back as tool response

The sidebar shows the status for each tab that you can click to inspect or navigate.

GitHub: https://github.com/tbocek/llm-local-web-search

Still a prototype and only tested with llama-server, but should work with OpenAI-compatible backends.

Feedback highly appreciated.

[ali0une]

Hi there.

Looks nice, will test. Thanks for sharing.