Skip to content

Release v0.2.0

Choose a tag to compare

@homer6 homer6 released this 25 Oct 21:07
· 32 commits to main since this release
3df9e05

agent-experiments v0.2.0

Released 2026-10-25. A minor release. Three security fixes since v0.1.0, from the
2026-10-21 security review. Private repository and image,
docker.io/oramasearch/agent-experiments:v0.2.0. Tracking issue:
#21.

This release is the tree of dev at 84fd433 (v0.1.0, the v0.1.0 image digest in its notes
(#14), and the three pull requests
below) with these notes and the version.

What it includes

Every pull request merged into dev since v0.1.0:

PR What
#13 The v0.1.0 release pull request (dev → main), carried back into dev
#14 The v0.1.0 image digest recorded in its notes
#16 No turn trace on the pod's disk
#17 The service token compared in constant time, and every turn refused when it is unset
#19 A turn's credential goes only to Lake at LAKE_URL

No turn trace on the pod's disk — #16

A turn no longer writes <TRACE_DIR>/<trace_id>.json. That file held the person's message and the
whole answer, workspace content on the disk of a pod every tenant shares
(#11, v0.1.0's first known issue).
Lake already keeps the whole answer in the task's sealed record in the turn's workspace Zetta, so
the local copy is dropped, not moved. The answer still carries trace_id. TRACE_DIR is no longer
read; the operator still sets it and the agent ignores it. The Dockerfile drops its default.

The service token: constant time, and required — #17

POST /v1/turn checks the bearer with hmac.compare_digest instead of !=
(#15). The route now fails closed:
with AGENT_SERVICE_TOKEN unset or empty, every turn is refused with 503 (v0.1.0 left it open). A
wrong or missing bearer is 401, as before. Turns from Lake's agent bus are unaffected.

A turn's credential only to Lake — #19

Neither POST /v1/turn nor a bus turn sends the turn's bearer to an address the caller names
(#18):

  • the model gateway is always this service's LAKE_URL; the fallback to the turn's lake_url is
    gone;
  • the turn's lake_url (Lake's workspace path) is accepted only on LAKE_URL's origin and under
    its path, with no user info, query, fragment, backslash or dot segments; without one the turn uses
    LAKE_URL;
  • with LAKE_URL unset, every turn is refused before any request goes out.

Before it rolls: settings

Setting Needed by State
AGENT_SERVICE_TOKEN #17: unset now refuses every turn (503) The operator renders it on every library agent
LAKE_URL #19: unset now refuses every turn The operator renders it
TRACE_DIR #16: no longer read The operator still sets /tmp/traces; harmless
AGENT_MODEL Rendered by the operator, but not read by this agent (#20) The agent reads EXPERIMENTS_AGENT_MODEL (default gpt-5.5), as in v0.1.0

A service run by hand needs AGENT_SERVICE_TOKEN and LAKE_URL set, or it refuses every turn.

What it does not include

Unchanged from v0.1.0, except that turn traces are no longer
kept anywhere by the agent:

  • Lake's own experiment names (start_experiment, experiment_id): the agent speaks the engine's
    study names through Lake's workspace adapter.
  • Calls to stop_study, list_studies or get_run_metrics from its own code (allowed, unused).
  • Persistent conversations: history lives in one process's memory.
  • Reading the operator's AGENT_MODEL (#20).
  • A live-model eval run in this release's verification.

Known issues

Security-relevant first. All open at this tag.

  1. Confirmation gates do not establish a separate human confirmer
    (lake#989): the reviewed object in context
    authorizes create_study and promote_trial, but Lake does not prove a person, rather than the
    caller that asked, confirmed it.
  2. Library agents hold live task credentials for every tenant they serve
    (lake#871), and a delegated turn is not
    attenuated to its parent task (lake#922).
  3. The workspace is never named explicitly
    (#3): no workspace_id on Lake or bus
    calls; the agent relies on the task credential being bound to the task's workspace. Also: no
    backoff on an idle bus.
  4. The agent ignores the operator's AGENT_MODEL
    (#20), found while cutting this
    release.
  5. The design turn asks instead of proposing on the e2e churn table
    (lake#1184): the study validator finds no entity
    column (lake e2e agents.py T12). The e2e script also confirms without proposal_task_id and
    proposal_sha256, so Lake refuses the turn
    (lake#1183).

v0.1.0's trace issue (#11) is fixed by
#16. v0.1.0's experiment_status failure on Lake (lake#797)
is closed.

Where it has run

The v0.2.0 tree has not run on the dev environment. No dev build of this repo was pinned on the
dev member of lake-nonprod; every Lake still runs the operator's default
oramasearch/agent-experiments:v0.1.0. Moving that default to :v0.2.0 is a separate operator
change, rolled through dev → testing → staging → prod.

The image

Built from the tag v0.2.0 (3df9e05) on the cluster BuildKit with build-agent.sh (linux/amd64, the repository's Dockerfile), then tagged :v0.2.0 on that digest without rebuilding:

docker.io/oramasearch/agent-experiments:3df9e05@sha256:51906a21bed3b4a768e82d52545a1fb0607d0bae1ca99579b61b77cea349fc8a, also tagged :v0.2.0 (same digest). The Docker Hub repository answers 404 anonymously (private).

It is not rolled anywhere yet: pinning it on an environment is a separate change to the operator's set files, through dev, testing, staging and prod in order.

Verification

Proof Result
Test suite (uv run --frozen pytest -q -ra, macOS arm64, Python 3.12) 59 passed, 0 failed, 0 skipped. New since v0.1.0: tests/test_service_auth.py 13 (#17), tests/test_turn_destinations.py 17 (#19); tests/test_service.py asserts a turn writes no file (#16); tests/test_release.py 2 (the installed package is 0.2.0, these notes exist and are indexed)
Eval known-good-search-space (experiments-agent-evals) Not run (needs a live model)
Linux image build (cluster BuildKit, from the tag) Built from v0.2.0 with build-agent.sh: oramasearch/agent-experiments:3df9e05, also :v0.2.0, sha256:51906a21bed3b4a768e82d52545a1fb0607d0bae1ca99579b61b77cea349fc8a; private (404 anonymously)