-
Notifications
You must be signed in to change notification settings - Fork 0
Persistent Sandbox
Requirement: Run in a persistent sandbox environment with its own terminal, editor, and browser, so multi-step research (docs, deps, running code) happens autonomously.
Sourced from: Cognition Devin.
Status in atomic-forge: Not a goal — forge explicitly scopes to local/CI execution, not a full virtual desktop; browser access is out of scope per the README's "What this doesn't try to be" section.
Thin/adjacent literature — what exists benchmarks sandboxes rather than proposing a design forge should adopt:
- Training Software Engineering Agents and Verifiers with SWE-Gym (arXiv:2412.21139) — a training/eval environment built from real GitHub issues (repo + issue + executable tests); relevant as an evaluation harness reference, not a sandbox design forge needs to replicate.
- AgentBench (arXiv:2308.03688) — general LLM-as-agent evaluation across environments including OS/database/web tasks; establishes that broad-sandbox agents are evaluated on breadth of environment coverage, which is explicitly not forge's positioning.
No action recommended. This requirement pulls directly against the README's
stated non-goals ("Not a general production-infrastructure platform"). Including
it in the backlog is more a documentation exercise (know what Devin does and
why forge doesn't) than a real gap to close — flagged again in the Open
Questions section of the top-level requirements.md as likely scope creep.
Nothing — and saying so explicitly is the win. Devin's persistent terminal+editor+browser sandbox is expensive to build and run; competing on it means competing on infrastructure spend, not on the repair-loop quality that's forge's actual thesis. The correct competitive move is a clear statement in the README/docs: forge intentionally stays a library/CLI you run in your environment (local, CI, or your own sandbox), so users who already have infra (a CI runner, a devcontainer) don't pay for one they don't need. If a user's workflow genuinely needs autonomous doc-browsing or dependency research, that's the signal to integrate forge as a component inside an orchestrator like OpenHands/Devin, not to rebuild their sandbox.
No build phases — this is a documentation/positioning task only.
- Add a short "why not a sandbox" paragraph to the README's existing "What this doesn't try to be" section (mirroring the tone already used there for language servers and production infra), explicitly naming Devin/OpenHands as the comparison so readers evaluating forge against them get a direct answer instead of an omission.
- Revisit only if a specific, named user workflow surfaces that genuinely requires it — track such requests as GitHub issues rather than pre-building speculative sandbox support.
atomic-forge — an agentic generate → test → repair loop with a machine-checked task contract, crash-safe checkpointing, and execution-selected repairs. BSL 1.1 licensed.
Start here
Workflows
Reference
Background
Requirements (R1–R16)
- Requirements-and-Roadmap
- Agent-Computer-Interface
- Critic-Verification-Gate
- Planner-Executor-Split
- Repo-Scale-Context
- Auto-Commit-Messages
- Persistent-Sandbox
- Multi-Channel-Intake
- Review-Comment-Driven-Fix
- Zero-Friction-Integration
- Self-Review-Issue-Resolution
- Enterprise-Scale-Indexing
- CLI-CI-Native
- Parallel-Execution
- Execution-Guided-Repair
- Data-Privacy-No-Training
- Environment-Bootstrap