Agentic Engineering Lab is a local-first reference system for building and evaluating three constrained coding agents.
- A read-only repository scout produces grounded implementation plans.
- A pull-request risk assessor explains risk, required proof, and uncertainty.
- A CI fixer diagnoses failures and can update an opted-in pull-request branch only after deterministic safety gates pass.
The system is built for evidence, not demo theater. Every run records its pinned repository revision, model configuration, tool use, policy decisions, costs, latency, validations, and outcome.
The first target is Mission Control. It is the only allowlisted repository during the initial evaluation cycle. The lab itself is public under Apache-2.0. Runtime services run locally with Docker Compose.
- Product requirements
- System architecture
- Data model and state machine
- API, webhook, and tool contracts
- Repository execution manifest
- Security and policy specification
- Evaluation specification
- Implementation plan
FastAPI and PostgreSQL form the control plane. Pydantic AI supplies typed model and tool contracts. OpenRouter supplies model access. Langfuse Cloud provides private traces. Disposable credential-free Docker executors run repository commands. A single GitHub App is mediated entirely by a deterministic capability gateway.
Implementation follows the milestone sequence in the implementation plan.
- Copy
.env.exampleto.envand replace the placeholder secrets with local values. - Install the locked development environment with
uv sync --all-extras. - Run the checks with
uv run ruff check .anduv run pytest. - Start the local control plane with
docker compose up --build.
The API is available only on 127.0.0.1:8000. GET /healthz reports process liveness and GET /readyz verifies configuration plus database access.
The control plane and Scout vertical slice are complete and verified with a live pinned run. Event routing, typed diff and check evidence, evaluation gates, disposable executor transport, fixed recipe adapters, patch policy, and the production GitHub branch writer have automated coverage. Thirty approved SHA-backed fixtures pin ten live pull requests and their failing checks. The published evaluation executor image passes reproduction, patch validation, and lint probes at its immutable digest. Candidate runs, held-out reviews, and an opted-in live patch remain gated work. See the current milestone status for exact evidence and blockers.