Skip to content

Waza v0.40.0

Choose a tag to compare

@github-actions github-actions released this 04 Nov 12:05
· 20 commits to main since this release
93e80d7

Highlights

  • Run an exact work unit: Negotiate runner capabilities, validate a
    captured shard/task/trial/attempt and receive an input-derived identity and a
    structured terminal outcome. The mock/text profile runs offline; the
    single-turn Copilot/text profile requires an explicit model and paid-execution
    consent, with tools and skills disabled.
  • Use the public runner reference: The Linux/AMD64 image below has been
    anonymously pulled by immutable digest and checked against its signed
    provenance and production-caller mock and bundled native synthetic-provider
    controls. This does not establish live-provider reliability or general
    file/tool/skill support.
  • Move a selected AgentV assertion: Pinned offline import/export supports
    one selected case-sensitive contains assertion, not an entire task or
    suite. Unsupported selected semantics fail rather than being approximated.
  • Inspect richer evaluation evidence: Task-level MCP mocks, recorded host
    lifecycle events, program-grader context and the Lab conversation viewer
    provide more precise, scoped observations. New results use schema 1.8;
    historical results remain readable.

The public image reference is:

ghcr.io/microsoft/waza-runner-reference@sha256:ded068a636dc721b8e38dc2a68bcbcbdb0d4b33ce5da8d182d562d189a712a39

Its source is commit 93e80d7;
see the publisher
and anonymous-digest verifier.
Only linux/amd64 is published and verified for this image.

Compatibility and operational notes

  • A task-level mcp_mocks key that older versions ignored now takes effect.
    before_run also runs before task loading and MCP admission, so review
    existing task files and hooks when upgrading.
  • Runner compatibility remains opt-in and limited to one mock/text task, trial
    and attempt. Full external task/suite interoperability remains deferred
    (#789).
  • An earlier report of multi-trial timeout/partial-result behavior remains open
    (#865). The new bounded runner
    timeout controls do not establish that the earlier issue is fixed or that it
    reproduces in this release.
  • Official standalone binaries report 0.40.0. The immutable tag's version.txt and
    extension.yaml still say 0.39.1 because the established release workflow
    synchronizes those files afterward on main. For a versioned source build use
    make build VERSION=0.40.0; later synchronization does not alter this tag.
  • The reference image's binary is built without a release version stamp and
    reports dev; identify this image by its immutable digest and source
    provenance rather than its binary version string.
  • The bundled Copilot Go SDK is 1.0.28 and bundled CLI is 1.0.105.

What's Changed

New Contributors

Full Changelog: v0.39.1...v0.40.0