Skip to content

v0.12.1

Choose a tag to compare

View all tags
@coder-eval-release-bot coder-eval-release-bot released this 12 Sep 20:38
· 17 commits to main since this release
v0.12.1
587f2e3

Bug Fixes

  • Code review fixes for record-cli-review-fixes
    (#150,
    3aca8e8)

  • Resolve py/import-and-import-from CodeQL alerts in test_regrade.py +
    test_detached_grading_boundaries.py (#161,
    6ab6b87)

  • criteria: 2/4 — a shim rule fault is an eval-config error, not an agent failure
    (#150,
    3aca8e8)

  • evaluate: Close the PR review findings on container-based detached grading
    (#161,
    6ab6b87)

  • evaluate: Close the review blockers on container-based detached grading
    (#161,
    6ab6b87)

  • harbor: Address code review findings from full 8-axis review
    (#166,
    9caffcb)

  • harbor: Address PR review blockers (score-integrity, security, drops)
    (#166,
    9caffcb)

  • harbor: Derive a prebuilt image's real WORKDIR instead of guessing /app
    (#166,
    9caffcb)

  • harbor: Suppress pyright reportMissingImports for the harbor package
    (#166,
    9caffcb)

  • models: Reference FlagPredicate at runtime so the cast is a real use
    (#150,
    3aca8e8)

  • record_cli: Close three real holes the Copilot review found
    (#150,
    3aca8e8)

  • record_cli: Reject an unusable response rule at load, and trace a shim fault
    (#150,
    3aca8e8)

  • sandbox: Give the sandbox venv system site packages
    (#162,
    e7d8326)

  • test: Strip ANSI color before asserting --workspace-dir in CLI output
    (#166,
    9caffcb)

  • tests: Harden harbor CLI-error assertions and Windows chmod checks
    (#166,
    9caffcb)

  • timing: Account for generation and tool time on every harness
    (#164,
    87102a3)

Build System

  • docker: Bake the harbor extra into the coder-eval-agent image
    (#166,
    9caffcb)

Continuous Integration

  • harbor: Add Harbor E2E workflow (export + CoderEvalAgent round trip)
    (#166,
    9caffcb)

Features

  • evaluate: Grade a driver: docker row inside a container of its own image
    (#161,
    6ab6b87)

  • harbor: Coder-eval as a Harbor agent (C1.2)
    (#166,
    9caffcb)

  • harbor: Export coder-eval tasks to Harbor, with coder-eval as the grader
    (#166,
    9caffcb)

  • harbor: Export experiment.yaml variants to Harbor task directories
    (#166,
    9caffcb)

  • harbor: Fix agent workspace alignment, env passthrough, and template sources
    (#166,
    9caffcb)

  • harbor: Task.yaml/experiment.yaml → Harbor export + coder-eval as a Harbor agent
    (#166,
    9caffcb)

  • record_cli: Serve a different canned response per invocation
    (#150,
    3aca8e8)

Refactoring

  • record_cli: 1/4 — copy argv_match beside the shim instead of splicing it
    (#150,
    3aca8e8)

Testing

  • Close three harness gaps this review surfaced
    (#150,
    3aca8e8)

  • lint: 4/4 — put the record_cli authoring surface under CE030 doc parity
    (#150,
    3aca8e8)

  • tasks: 3/4 — add the record_cli per-invocation-response probe
    (#150,
    3aca8e8)

Assets 2
Loading