Completely free, private, UI based Tech Documentation MCP server. Designed for coders and software developers in mind. Easily integrate into Cursor, Windsurf, Cline, Roo Code, Claude Desktop App
Transform Web Content into LLM-Ready Data
AI web scraper built with Crawl4AI for extracting structured leads data from websites.
Web crawling tool that integrates with AI assistants via the MCP
Integrates Supabase with Crawl4AI and AI Chat to create a powerful web crawling and semantic search solution. Streamlit supabase data visualization. Run all in Docker. API and more!
The Web Metadata Extraction Toolkit is designed to streamline the process of extracting, cleaning, and analyzing metadata from websites. Utilizing advanced AI models and custom extraction strategies, this toolkit helps users efficiently gather data like titles, descriptions, and keywords, which are crucial for SEO and content strategy.
Crawl4DeepSeek = Crawl4AI + DeepSeek 🚀 Smart, efficient, and built for deep web exploration! 🌐🤖
A feature-rich web application for automated news scraping and summarization. It allows users to enter article URLs, fetches the full content, and generates concise summaries. The system supports both local inference with custom models and remote deployment via FastAPI or Streamlit interfaces.
TypeScript implementation of an MCP server for Crawl4AI. Provides tools for web crawling, content extraction, and browser automation.
Generate YouTube Shorts Video From an Article Link using Pydantic AI
Docker Compose to install N8N, Openweb UI, Qdrant, Ollama, EvolutionAPI and other systems.
Puppeteer & Crawl4AI microservice for web automation, scraping, and AI processing with Bull queues
A web application that classifies reviews as real or fake by utilizng an NLP model (SVC classifier). It leverages crawl4ai for scraping reviews off of any product/service page, feeds it to the NLP model whose output gets displayed to the users.
Retrieval-Augmented Generation server with Pinecone and OpenAI
🕷️ A lightweight Model Context Protocol (MCP) server that exposes Crawl4AI web scraping and crawling capabilities as tools for AI agents. Similar to Firecrawl's API but self-hosted and free. Perfect for integrating web scraping into your AI workflows with OpenAI Agents SDK, Cursor, Claude Code, and other MCP-compatible tools.
AI Scraper : scrap and extract data from website in any format (CSV, JSON, HTML...) using Selenium or Crawl4ai, and using Ollama or Sambanova API, and using Streamlit for UI as chatbot
A simple proxy server to integrate crawl4ai with OpenWebUI
AI Web Crawler is a powerful, AI-powered web crawler that extracts product information from e-commerce websites and downloads associated PDF documents. Built with modern Python technologies and featuring intelligent pagination handling, duplicate detection, and advanced PDF processing.
A friendly AI chatbot that shares the wisdom of Utkarsh Classes by default, while letting you effortlessly transform any website into your personalized Q&A learning hub
Add a description, image, and links to the crawl4ai topic page so that developers can more easily learn about it.
To associate your repository with the crawl4ai topic, visit your repo's landing page and select "manage topics."
