v1.1.0

What's Changed

• chore(release): start 1.1.0-dev by @whexy in #86
• feat(models): refresh the Claude, GPT and Gemini model lists and prices by @whexy in #91
• build(deps): Bump the rust group across 1 directory with 11 updates by @dependabot[bot] in #72
• fix(daemon): run tool calls off the actix workers by @whexy in #66
• fix(nix): include the pilot images lock in the catalog package source by @whexy in #99
• build(deps): bump the Go modules and refresh the Nix vendor hashes by @whexy in #94
• build(deps): update the web UI JavaScript dependencies and adapt the web UI by @whexy in #92
• feat(run): print the grade and run directory, add --require-pass by @whexy in #97
• feat(plugins): report a skipped plugin on the console and in the summary by @whexy in #96
• docs(demo): document macOS and Docker Desktop requirements and caveats by @whexy in #95
• fix(run): record an error when the agent failed and the model never answered by @whexy in #101
• build(agents): update Claude Code, Codex and OpenCode, and keep them offline by @whexy in #102
• fix(nix): make the pytest, daemon and clippy checks pass in the Nix sandbox by @whexy in #103
• chore(dataset): pin the published pilot images by @whexy in #104
• fix(images): bound the OpenCode seed step so an image build cannot hang by @whexy in #105
• build(webui): move to Vite 8 and plugin-react 6 by @whexy in #100
• test(bench): keep the tag-pull tests independent of the committed images lock by @whexy in #106
• ci: make pull request CI a light gate and add just verify by @whexy in #107
• build(deps): update the Docker base images and move Bun to 1.4.2 by @whexy in #108
• build(deps): move the web UI to React 19 and the docs to VitePress 2.0.0-alpha.20 by @whexy in #114
• build(deps-dev): bump TypeScript to 5.9.3 by @whexy in #117
• chore(release): 1.1.0 by @whexy in #118

New Contributors

• @dependabot[bot] made their first contribution in #72

Full Changelog: v1.0.0...v1.1.0

v1.0.0

What's Changed

• fix(release): check out before downloading the Helm chart by @whexy in #82
• fix(tasks): build case images without a provenance attestation by @whexy in #83
• fix(demo): read the web UI's current health and run IDs by @whexy in #84
• chore(release): 1.0.0 by @whexy in #85

Full Changelog: v1.0.0-rc.1...v1.0.0

v1.0.0-rc.1

What's Changed

• docs: add a contact email and link a contributor profile by @whexy in #1
• docs: organize the site into sections and check it against the code by @whexy in #2
• fix(webui): stop shell injection and lock down network access by @whexy in #3
• build(python): one uv workspace and an importable ssebench package by @whexy in #5
• build: add Rust, Go and Bun workspaces with pinned toolchains by @whexy in #4
• docs(dataset): record third-party licenses and provenance of the pilot tasks by @whexy in #6
• feat(cli): extension points for tool layers and CLI commands by @whexy in #8
• build: one version for every component, with a bump tool by @whexy in #10
• feat(dataset): one task schema, a generated manifest, and a catalog that serves it by @whexy in #11
• feat: just front door, generated local secrets, isolated proxy stacks and ssebench doctor by @whexy in #12
• build(nix): one blueprint flake for every component, devshell and checks by @whexy in #13
• fix(integrity): enforce difficulty in the daemon and keep the answer from the agent by @whexy in #9
• feat: read the task catalog from a manifest file or URL, bundled by default by @whexy in #14
• refactor(entrypoint): container modes as an extension point by @whexy in #17
• docs(concepts): write the concept pages and the integrity and egress page by @whexy in #18
• build(dataset): pin the base images and the inputs of the pilot task images by @whexy in #19
• feat: add a reference agent that applies the task's known fix by @whexy in #21
• docs(reference): generate the reference pages and fail CI when they drift by @whexy in #22
• test(sdk): drive the integration test through the daemon's admin socket by @whexy in #20
• ci: add GitHub Actions CI, secret scanning, Dependabot and contributor templates by @whexy in #7
• ci(dependabot): pause version updates until the first release by @whexy in #34
• fix(sidecar): make sidecar mode work end to end and keep the agent from the answer by @whexy in #33
• ci: build and publish the images, pin upstream versions, and build release binaries by @whexy in #16
• chore: pay down lint debt, fix the report and make the checks strict by @whexy in #35
• feat: run plugins at the agent and grading hooks by @whexy in #37
• ci(release): publish the packages and the GitHub release for a version tag by @whexy in #39
• fix(ci): give the image plan job the history paths-filter needs on push by @whexy in #40
• feat(cli): run from the ssebench wheel without a checkout by @whexy in #42
• docs(webui): describe launching runs, the run view, security and the local stack by @whexy in #46
• fix: complete task prompt, honest grade status and difficulty range checks by @whexy in #36
• fix(daemon): capture the agent's whole working tree against its base commit by @whexy in #38
• fix(agents): run the bundled agents without internet, fix the codex agent, update models by @whexy in #41
• feat(demo): add the local demo, just demo by @whexy in #43
• docs(guides): write the add-an-agent and add-a-task guides, update add-a-model by @whexy in #45
• fix(dataset): make every pilot task grade correctly with the reference and dummy agents by @whexy in #47
• feat(dataset): verify tasks end to end with the reference and dummy agents, on PRs and weekly by @whexy in #48
• docs(dataset): write the pilot dataset card and retire the offline validator by @whexy in #50
• fix(security): run agent-controlled code unprivileged and make grades unforgeable by @whexy in #44
• docs: write the quickstart and troubleshooting, and update the repository-level docs by @whexy in #51
• fix(runtime): honest test_patch results, one-line CLI errors, graceful stop and the agent's home by @whexy in #52
• fix(webui): track each launch by its run ID, finish launched runs, and fix the wizard, stop and assistant flows by @whexy in #49
• feat(entrypoint): support modes that own stdio or take no agent command by @whexy in #55
• ci(dataset): publish verified pilot case images and pin them by digest by @whexy in #53
• feat: build tool and agent layers for arm64, and run amd64-only tasks under emulation by @whexy in #54
• feat(runner): write each run to a results directory of its own by @whexy in #56
• fix: small defects in the build, runner, bash tool, oracle plugin and agent wrappers by @whexy in #57
• refactor(runner): run containers through a Backend interface, with prebuilt images by @whexy in #58
• fix(stack): fail fast when the proxy exits; fix the install, sizing and timing docs by @whexy in #59
• feat(webui): talk to runs through the runner backend, read finished runs, add hosted mode by @whexy in #60
• feat(backends): add a Kubernetes backend by @whexy in #61
• fix(dataset): let the task runner read Rust dependencies and stop two flaky test suites by @whexy in #62
• feat(deploy): add a Helm chart for the Kubernetes deployment by @whexy in #63
• fix(webui): import only the brand icons the UI draws by @whexy in #64
• fix(daemon): stop every listener together and exit within seconds of SIGTERM by @whexy in #65
• ci(release): publish ssebench-sdk from its own environment by @whexy in #67
• ci(dependabot): resume version updates by @whexy in #68
• docs(release): serve the docs at ssebench.b3yond.ai by @whexy in #69
• fix(webui): build the CLI wheel with the build platform's uv by @whexy in #79
• test(daemon): count the daemon's threads once the count settles by @whexy in #80
• chore(release): 1.0.0-rc.1 by @whexy in #81

New Contributors

• @whexy made their first contribution in #1

Full Changelog: https://github.com/42-b3yond-6ug/ssebench/commits/v1.0.0-rc.1