An AI-powered platform that understands, audits, and optimizes websites — from code to content.
WebInsight AI is an open-source intelligence platform built to analyze websites deeply — from their HTML structure and SEO health to design, performance, and content quality. It combines web crawling, data analysis, and AI insights to deliver actionable recommendations that help you build better websites.
To build an autonomous system that can analyze, reason, and improve any website automatically — like having a 24/7 web consultant powered by AI.
- 🌍 Deep Website Crawling — full-site recursive crawling with Playwright.
- 🧩 Content Analysis — readability, tone, keyword optimization using NLP.
- ⚙️ SEO & Performance Audit — meta tags, speed, structure, accessibility.
- 🧠 AI Insights Layer — GPT-powered recommendations and code fixes.
- 📊 Web Dashboard (Next.js) — interactive report visualizations.
- 🤖 Automation Agent — scheduled re-audits and GitHub PR suggestions.
| Layer | Tools |
|---|---|
| Backend | FastAPI, Playwright, BeautifulSoup4, PostgreSQL |
| AI Engine | OpenAI / Ollama, LangChain, FAISS / Chroma |
| Frontend | Next.js / React |
| Infrastructure | Docker, AWS / Railway / Render |
| Phase | Focus | Status |
|---|---|---|
| 1 | Core crawling & parsing engine | ⏳ Planned |
| 2 | AI report generator | ⏳ Planned |
| 3 | Dashboard & API | ⏳ Planned |
| 4 | Agent automation | ⏳ Planned |
| 5 | Cloud deployment | ⏳ Planned |
Contributions are welcome!
Please check /docs/contributing.md for setup and PR guidelines (coming soon).
Licensed under the Apache License 2.0 — free for open use and research. For commercial usage or SaaS adaptation, please contact the author.
Suvam Naskar Cloud Engineer • Full Stack Developer • CIO LinkedIn • GitHub