v0.0.7

AgentCore Launchpad v0.0.7 adds per-agent evaluation history and comparison, per-person cost controls, and a more guided V2 console experience.

This release was updated to commit c49039dd0134ac18864c084990b61efbd4aee66c, adding #294 and #295 after the initial v0.0.7 publication.

Highlights

• Evaluation history and comparison: open Evaluation Tasks on per-agent scorecards, follow trends on the same benchmark, inspect version-by-evaluator summaries, and select two runs for overall or aligned case-by-case comparisons. Re-run eligible evaluations, filter the agent list, and preview session inputs and outputs in the trajectory picker. The architect's step 2 now shows run history, evaluator breakdowns, and changes by agent version using the same scorecard rules.
• Spend, budgets, and alerts: review spend by agent and person, configure threshold alerts with optional webhook delivery, assign monthly budget levels, and inspect personal usage. Long-running work records its payer and stops at supported safe boundaries when the budget is exhausted. Reconciliation replaces estimates with measured usage and accounts for AgentCore fees.
• Agent configuration history: inspect saved configuration snapshots, compare changes, and roll back through the deployment pipeline. The V2 create flow adds deployment progress, integration snippets, a quick chat, inline knowledge-base setup, and URL-backed filters.
• Model administration: manage deployment-wide model defaults and price overrides from the console, reset defaults, and probe model availability.
• Console navigation and feedback: use an essentials-only sidebar, command palette, glossary, help menu, launch checklist, and guided tour. Attention panels can be dismissed; chat ratings feed negative-feedback review in Insights. Runtime canaries are now the first A/B experiments tab.
• Reliability: observability counts AgentCore traces once, attention panels suppress stale evaluation failures, alert re-checks tolerate concurrent rule deletion, and transient-retry tests isolate their own evaluation runs.

Upgrade notes

• The Environments page and its compare/drift API have been removed. Agent configuration snapshots, diffs, and rollback remain available on agent details.
• Budget enforcement remains inactive until an administrator defines budget levels. Before assigning limits, configure prices for the models in use and review estimates for runtimes that do not report usage.
• Budget reconciliation is enabled by default and performs billable CloudWatch queries. Set LAUNCHPAD_BUDGETS_RECONCILE_ENABLED=false if reconciliation should remain disabled. Alert webhook scheduling is opt-in.
• Historical runs are assigned inferred snapshots only when deployment history supports the match. Runs older than all snapshots stay unknown when an intervening deployment succeeded, avoiding a false assignment to version #1. Per-case comparison depends on readable, alignable benchmark data; otherwise the console compares overall scores.
• Follow the production runbook for ledger backup, in-flight work checks, and deployment.

Validation

Release target: c49039dd0134ac18864c084990b61efbd4aee66c from main.

The full make verify gate passed in an isolated checkout with locked dependencies:

• 6,377 backend tests and 48 infrastructure tests.
• 603 frontend tests across 56 files, ESLint, TypeScript checks, and the Vite production build.
• Local lifecycle lint/syntax checks, English/Chinese translation parity, and Chinese punctuation checks.

The existing non-blocking React Hooks lint warning in EvaluationExperiment.tsx remains.

What's Changed

• V2 Observability ranks what needs a look and opens the failed traces by @xiehust in #268
• V2 list pages open with what needs attention: seven more modules by @xiehust in #269
• V2 shell: essentials-only sidebar, glossary, command palette and help menu by @xiehust in #270
• V2 agent create flow: deploy line, URL filters, integration snippets, try-chat, inline KB by @xiehust in #271
• V2 onboarding: launch checklist and a guided tour by @xiehust in #272
• Rate V2 Chat answers with a thumb; Insights lists the thumbs-down by @xiehust in #273
• Observability counts AgentCore traces, each once by @xiehust in #274
• Platform models become admin-overridable settings; prices cover the offered models by @xiehust in #275
• V2 spend by agent and person, and threshold alert rules with an opt-in webhook check by @xiehust in #276
• V2 agent config snapshots with diff and rollback, and environment compare and drift by @xiehust in #277
• Alert re-check survives a rule deleted mid-pass; offer GPT-6.1 Sol and GLM 5.3 by @xiehust in #278
• Hide the drift check from the V2 Environments page by @xiehust in #280
• Remove the Environments page and its compare/drift API by @xiehust in #281
• Per-person budgets (core): levels, usage ledger, prices, a hard-limit gate on every billable route, My usage by @xiehust in #282
• Per-person budgets for long-running jobs: payers, exact usage, estimates, safe-boundary stops by @xiehust in #284
• Per-person budgets: reconciliation and AgentCore fees (Runtime compute with idle tail, Memory, Gateway, Web Search, evaluations) by @xiehust in #285
• Eval transient-retry tests count only their own run (fixes a flaky verify gate) by @xiehust in #286
• Open the V2 architect's created datasets and evaluators on V2 pages by @xiehust in #283
• Show each session's input and output in the task wizard's Agent-trajectory picker by @xiehust in #287
• Evaluation scorecards backend: version stamps, scenario map, scorecard / compare / re-run routes by @xiehust in #289
• Compare two evaluation runs case by case in the V2 console by @xiehust in #290
• Open evaluation tasks on a per-agent scorecard in the V2 console by @xiehust in #291
• Dismiss V2 attention items, and stop listing stale evaluation failures by @xiehust in #292
• Put the runtime-canary tab first on the V2 A/B experiments page by @xiehust in #288
• Filter the 按 Agent table, hiding deleted agents by default by @xiehust in #293
• Show the architect's step 2 runs per version, on the scorecard rules by @xiehust in #294
• Leave a run's version unknown when the agent was redeployed before its first snapshot by @xiehust in #295

Full Changelog: v0.0.6...v0.0.7