Skip to content
Syed Asif edited this page Jun 12, 2026 · 13 revisions

web-search-mcp

web-search-mcp is a FastMCP server providing web search, content extraction, and research tools for LLM clients. It implements the Model Context Protocol (MCP) to give LLMs access to real-time web information across multiple free data sources.

Quick Start

Prerequisites

  • Python 3.11+
  • uv for dependency management

Installation

git clone https://github.com/sydasif/web-search-mcp.git
cd web-search-mcp
uv sync

Running the Server

uv run web-search-mcp

Core Capabilities

  • Web Search: Fast, raw search results via DuckDuckGo, plus domain-scoped documentation search.
  • Content Extraction: Clean text extraction from URLs with multiple output formats.
  • Academic Research: arXiv paper search across all scientific categories.
  • Community Signal: Reddit search for real-user experiences and discussions.
  • Tech Discourse: Hacker News search for developer opinions and startup discussions.
  • Code Discussions: GitHub Issues and PRs search across repositories.
  • Real-time Discourse: X/Twitter search for breaking news and community reactions.
  • AI Research: Deep research and page analysis via Groq GPT-OSS and Compound systems.
  • Developer Tools: Package registry lookups (npm, PyPI, crates.io, Go), error message analysis, technology comparison.

Sources at a Glance

Source Tools Auth
DuckDuckGo web_search, fetch_page None
Reddit reddit_search None
Hacker News hackernews_search None
GitHub github_search, get_github_issue Optional token or gh CLI
Wikipedia wikipedia_search None
arXiv arxiv_search None
X/Twitter x_search AUTH_TOKEN + CT0
Groq groq_search, groq_analyze_page GROQ_API_KEY
Developer package_info, package_search, translate_error, compare_tech None

Architecture | Tools | Tools-Status | Development | Configuration

Clone this wiki locally