services

Services

GroktoCrawl is composed of 8 core containers and 2 optional services, all managed by docker-compose.yml. Only the agent API, portal, semantic service, and SearXNG expose host ports -- internal services communicate via Docker internal DNS.

Active contributors: groktopus

Available services

• agent-svc -- main FastAPI API and async job workers
• scraper-svc -- URL to markdown conversion pipeline
• browser-svc -- Playwright headless browser sessions
• semantic-svc -- embeddings, reranking, and vector index
• portal-svc -- web UI for human users
• parse-svc -- PDF, DOCX, PPTX, XLSX to markdown
• search-svc -- search fixture for local testing
• llm-svc -- LLM fixture for local testing