Skip to content

fix: show live run names before completion#1199

Merged
christso merged 2 commits intomainfrom
fix/1198-run-name-live
Apr 30, 2026
Merged

fix: show live run names before completion#1199
christso merged 2 commits intomainfrom
fix/1198-run-name-live

Conversation

@christso
Copy link
Copy Markdown
Collaborator

Summary

  • infer experiment names for live run metadata before result rows persist them
  • use shared Studio run-label formatting in the run list and sidebar
  • cover both single-benchmark and multi-benchmark live-run paths with regressions

Closes #1198

Red/green verification

Red

While a run was still active, /api/runs returned the live run with a timestamp display name and no experiment:

{
  "filename": "issue-1198-live-name::2026-04-29T09-17-30-111Z",
  "display_name": "2026-04-29T09-17-30-111Z",
  "target": "llm-dry-run"
}

That made Studio show the timestamp instead of the final target/experiment-derived label.

Green

Replaying the same scenario after the fix returned the live run with the experiment available immediately:

{
  "filename": "issue-1198-live-name-fixed::2026-04-29T09-24-12-067Z",
  "display_name": "2026-04-29T09-24-12-067Z",
  "target": "llm-dry-run",
  "experiment": "issue-1198-live-name-fixed",
  "label": "llm-dry-run · issue-1198-live-name-fixed"
}

So the in-progress run now uses the same final label inputs before completion.

Validation

  • bun test apps/cli/test/commands/results/serve.test.ts apps/studio/src/components/run-eval-threshold.test.ts apps/studio/src/lib/run-label.test.ts
  • bun run lint

christso and others added 2 commits April 30, 2026 03:39
Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
@christso christso merged commit 4d57295 into main Apr 30, 2026
4 checks passed
@christso christso deleted the fix/1198-run-name-live branch April 30, 2026 01:57
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

bug: run name displays timestamp instead of target - experiment until run is finished

1 participant