robotstxt.ai v1.0.0
Visual robots.txt manager for the AI era.
Features
- 20+ AI bots database (GPTBot, ClaudeBot, PerplexityBot, Google-Extended, CCBot, Bytespider, etc.)
- Visual toggle UI to block/allow each bot
- One-click "Block All AI" / "Allow All AI"
- robots.txt generator with sitemap URL + custom rules
- robots.txt analyzer — fetch from any URL or paste content
- Syntax-highlighted output with copy/download
- MCP server with 5 tools (fetch, analyze, generate, list bots, check status)
- SKILL.md for 30+ AI agents (Claude Code, Codex, Cursor, Copilot, etc.)
- Cursor plugin manifest
Links
- Live demo: https://robotsai.sharozdawa.com
- MCP server:
mcp-server/directory - Agent skill:
.claude/skills/robots-ai/SKILL.md