Releases: understudylabs/understudy-agent-tools
Releases · understudylabs/understudy-agent-tools
Release list
Understudy Desktop v0.3.44
What's Changed
- Account view: remove Install into coding agents card by @lluisinthedesert in #367
- Desktop UI: Summary, Analytics destinations, Workloads inline-config, Models catalog by @lluisinthedesert in #368
- release: Desktop 0.3.44 / CLI 0.6.41 by @lluisinthedesert in #369
- docs: real README for Understudy Desktop by @lluisinthedesert in #370
Full Changelog: desktop-v0.3.43-mvp...desktop-v0.3.44-mvp
Understudy Desktop v0.3.43
What's Changed
- Desktop training pane: visual polish (CTA clipping, scrollbar, stepper rhythm) by @lluisinthedesert in #364
- Rail toggle: Cmd+B shortcut + hover tooltip by @lluisinthedesert in #365
- release: Desktop 0.3.43 / CLI 0.6.40 by @lluisinthedesert in #366
Full Changelog: desktop-v0.3.42-mvp...desktop-v0.3.43-mvp
Understudy Desktop v0.3.42
What's Changed
- fix(orchard): correct JS quote escaping in viewer template by @lluisinthedesert in #360
- Workload intake: drop a folder, Pi profiles it and proposes a benchmark by @lluisinthedesert in #362
- release: Desktop 0.3.42 / CLI 0.6.39 by @lluisinthedesert in #363
Full Changelog: desktop-v0.3.41-mvp...desktop-v0.3.42-mvp
Understudy Desktop v0.3.41
Understudy Desktop 0.3.41 bundles CLI 0.6.38 and brings the benchmark lab into the app.
Highlights
- Experiment lineage cards — every result in the app now traces back to the run, dataset, and prompt that produced it (
understudy.experiment.v1sidecar). - Upload approval gate — the drag-drop training flow asks before anything leaves your machine; nothing uploads without an explicit yes.
- Benchmark linkage pane — see which benchmark and split each experiment was scored against, right next to the result.
- Pi chat benchmark tools — the embedded Pi chat is wired to the benchmark/experiment spine, and the new
operate-benchmark-labskill drives the whole lab conversationally. - Sidebar cleanup — New chat unnested to the top level; clipping, overlap, and leftover artifacts fixed.
- Smart defaults in the bundled CLI — a one-time trust posture replaces per-call approval prompts.
- The full benchmark CLI spine —
benchmarks from-datasetturns labeled datasets into first-class benchmarks; the partner report produces the honest benchmark-and-savings deliverable; trivial-agent calibration arms, majority-class floors, and the ABC rigor report keep scores honest; GEPA-style prompt evolution runs over prompt-override experiment arms.
Existing installs update in place via the Tauri updater (latest.json on this release).
What's Changed
- Add local trace benchmark foundry by @lluisinthedesert in #314
- Benchmark hub: benchmark.v1 spine, local hub/leaderboard viewer, real dogfood data, correctness + hardening + tests by @lluisinthedesert in #315
- Benchmark hub: full foundry unification — lifecycle-aware viewer, one review store, one styling system, designed empty states by @lluisinthedesert in #317
- Complete trace foundry runtime and environment workflow by @lluisinthedesert in #316
- Add reusable local trace viewer by @aamir in #318
- Foundry fixes: cut Prime push (privacy), batch truncation, semantic gold, promote verb, schema-collision resolution by @lluisinthedesert in #319
- Roadmap wave: trace-aware grouping, judgeable contracts, run queue + executor, narrative layout by @lluisinthedesert in #320
- Automation-focus round: accepted-task runs, statement-first task page, regenerate-env + environment fixes by @lluisinthedesert in #321
- Live rollout watching + fair anchor scoring + world validation + judgeability guarantee by @lluisinthedesert in #322
- Fix live-journal newlines (empty live view during real rollouts) by @lluisinthedesert in #323
- Observation-tightened world-model validation by @lluisinthedesert in #324
- Unify benchmark artifact producer/consumer contracts behind one shared codec by @lluisinthedesert in #326
- Add ABC benchmark-rigor checkpoints to eval skills by @lluisinthedesert in #330
- docs: benchmark-hub → desktop migration scoping by @lluisinthedesert in #329
- Add instrument skill: zero-friction trace-capture on-ramp by @lluisinthedesert in #331
- Incumbent baseline: record the capture-producing model, rerun it as a labeled arm, gate tasks on calibration by @lluisinthedesert in #325
- fix(skills): add missing Resolve CLI section to instrument skill (unbreak main gates) by @lluisinthedesert in #332
- Sentinel gates against the silent-zero failure class by @lluisinthedesert in #328
- Agent-operator MCP surface: understudy benchmarks mcp by @lluisinthedesert in #327
- Trivial-agent calibration arms (null/spam) + ABC rigor report by @lluisinthedesert in #333
- Statistical honesty + environment integrity: bootstrap CIs, gold-leakage audit, rollout isolation pin by @lluisinthedesert in #334
- Exception-based benchmark review: auto-accept policy + conversational task edit by @lluisinthedesert in #335
- Fuzzy tier for the gold-leakage audit (shingles + fingerprints) by @lluisinthedesert in #336
- Surface follow-ups: floors rendering, MCP policy tools, configurable auto-accept by @lluisinthedesert in #337
- Oracle full-contract coverage: response obligations verified against stored gold by @lluisinthedesert in #338
- Harden benchmark run queue/executor: claims + capability gate, per-rollout timeout, structural output isolation by @lluisinthedesert in #339
- Prompt-override experiment arms (run-scoped SOP suffix, capability-gated) by @lluisinthedesert in #340
- Fixtures-state-split: stop serving gold post-state to candidates by @lluisinthedesert in #342
- App-replay arm (tier 1): run the user's own app on frozen benchmark tasks by @lluisinthedesert in #341
- benchmark hub: multi-objective (Pareto) trade-offs view by @lluisinthedesert in #343
- Skills: operate the full benchmark-lab lifecycle (MCP + CLI + daemons + desktop distribution) by @lluisinthedesert in #344
- Local trained-artifact arms + majority-class floor for the benchmark run executor by @lluisinthedesert in #345
- GEPA-style prompt evolution driving prompt_overrides arms (benchmarks evolve) by @lluisinthedesert in #347
- Rejection guidance as an optimizable surface: guidance.json, recovery metric, --guidance override by @lluisinthedesert in #348
- Experiment-lineage layer: understudy.experiment.v1 sidecar + CLI/MCP surfaces by @lluisinthedesert in #346
- Fix benchmark-hub visual-QA findings (hydration, floors, feedback ids, pills, dev preflight) by @lluisinthedesert in #350
- Born-accepted task inbox: proposed review flow + page redesign by @lluisinthedesert in #349
- OpenAI response-shaped workload fixes (warp-domain-identification generality validation) by @lluisinthedesert in #351
- Merge-train tooling: gated PR train, wave-ownership checker, retro doc by @lluisinthedesert in #352
- Wire the embedded Pi chat to the benchmark/experiment spine by @lluisinthedesert in #353
- benchmarks from-dataset: labeled datasets become first-class benchmarks by @lluisinthedesert in #354
- Desktop app → benchmark/experiment spine bridge (lineage, approval gate, benchmark linkage) by @lluisinthedesert in #355
- Partner report: the honest benchmark-and-savings deliverable by @lluisinthedesert in #356
- Smart defaults: one-time trust posture replaces per-call approval gates by @lluisinthedesert in #357
- Desktop sidebar cleanup: unnest New chat, fix clipping, remove artifacts by @lluisinthedesert in #358
- release: Desktop 0.3.41 / CLI 0.6.38 by @lluisinthedesert in #359
Full Changelog: desktop-v0.3.40-mvp...desktop-v0.3.41-mvp
Understudy Desktop v0.3.40
What's Changed
- ci: mirror desktop DMGs to R2 by @lluisinthedesert in #311
- Desktop: design language v2.0 alignment + WorkOS AuthKit user sign-in by @lluisinthedesert in #312
- release: Desktop 0.3.40 / CLI 0.6.37 by @lluisinthedesert in #313
Full Changelog: desktop-v0.3.39-mvp...desktop-v0.3.40-mvp
Understudy Desktop v0.3.39
What's Changed
- De-experimentalize the desktop → production train-api connection by @lluisinthedesert in #306
- feat(desktop): management consolidation — Aamir's control-plane surfaces + nav into the app by @lluisinthedesert in #308
- feat(desktop): management consolidation — control-plane surfaces + nav (ACTUAL migration) by @lluisinthedesert in #309
- release: Desktop 0.3.39 / CLI 0.6.36 by @lluisinthedesert in #310
Full Changelog: desktop-v0.3.38-mvp...desktop-v0.3.39-mvp
Understudy Desktop v0.3.38
What's Changed
- feat: remote training end-to-end for custom workloads — compile actor, generic recipes, doctor, API verbs, oracle dispatch by @lluisinthedesert in #302
- fix(release-check): built-CLI runtime assertion skips source stage without dist by @lluisinthedesert in #305
- fix(desktop): restore certified model downloads on clean Macs by @lluisinthedesert in #307
Full Changelog: desktop-v0.3.37-mvp...desktop-v0.3.38-mvp
Understudy Desktop v0.3.37
What's Changed
- feat(check-routing-health): adopt workload-status + usage-summary endpoints by @aamir in #293
- feat(desktop): make dropped task models active by @lluisinthedesert in #304
Full Changelog: desktop-v0.3.36-mvp...desktop-v0.3.37-mvp
Understudy Desktop v0.3.36
What's Changed
- fix(desktop): make portable model installation automatic by @lluisinthedesert in #303
Full Changelog: desktop-v0.3.35-mvp...desktop-v0.3.36-mvp
Understudy Desktop v0.3.35
What's Changed
- desktop: add portable task model bundles by @lluisinthedesert in #299
- fix(desktop): download task model bases automatically by @lluisinthedesert in #300
- chore(release): bump CLI to 0.6.32 by @lluisinthedesert in #301
Full Changelog: desktop-v0.3.34-mvp...desktop-v0.3.35-mvp