Release notes — 2026-05-28

[sarthakFuture]

Week of 2026-04-28
Features

• Perplexity Sonar Models Now Available for Evaluations: You can now use Perplexity's full Sonar model family (sonar, sonar-pro, sonar-reasoning, sonar-reasoning-pro, and sonar-deep-research), including the Agent API for agentic workflows with built-in web search, when running evaluations. Contributed by the Perplexity team. [PR Add Perplexity Search (Sonar) and Agent API models #650](https://github.com/future-agi/future-agi/pull/650).
• Use System Prompt as Context in Evals: You can now leverage your agent's system prompt as context when running system and custom evals, giving you a more complete view of how your prompts affect model outputs.
• New API: Access Eval Task Data Across Two Axis: Two new API endpoints are now live. You can access eval task results via API in two ways: a per-evaluator summary (pass rates, average scores, and choice distributions across the full task) and a per-span breakdown (each evaluator's result for every individual span). Both support optional date range filtering.

Bugs & Improvements

• Eval Results in Observe Now Display Correctly: In some cases, eval results in Trace Observe were not displaying correctly. This has been resolved and results now appear as expected.
• Eval Type Now Saved Correctly When Creating New Evaluations: When creating an LLM-as-judge or Code evaluation, the selected type was previously always saved as Agent. The correct eval type is now preserved in all cases.
• Eval Experience Improvements Across the Platform: A set of improvements to the eval creation and review experience: linking directly to a specific eval version now opens on that version; long task error messages collapse to a one-line summary with a Show more toggle; results no longer show stale data when switching between dataset, tracing, and simulation panels; variable highlighting in the prompt editor reflects which variables are actually mapped; clicking an execution row now opens that specific run rather than always opening the latest; and the ground-truth embedding status now updates in realtime, with no page refresh needed.
• Sessions View from the Users Tab No Longer Times Out: When navigating to the Sessions view from the Users tab, the page could get stuck on a loading screen or time out. Sessions now loads reliably from that entry point.
• Composite Evals No Longer Accept Other Composites as Children: When building a composite evaluation, the child picker now only lists individual, non-composite evaluators. Previously, composite evals could be selected as children, which produced unexpected results.
• Usage and Billing Page Display Accuracy Improved: Several display issues on the Usage and Billing page have been fixed: AI credits were showing incorrect units, time period labels on usage cards were inaccurate, chart axis labels showed duplicates or mixed formatting, and the pricing tier table now includes column headers and correct unit labels.
• Observe Span and Trace List Loads Faster and More Reliably: Several issues that caused slow or incomplete loading in Trace Observe have been fixed. Projects with larger trace volumes should see improved load times when browsing spans and traces.
• Filtering in Trace Observe Now Works Correctly: Several filter issues have been resolved: multi-select filters such as node type, model, and span name were in some cases not being applied; Trace ID and Span ID fields now accept a single value and continue filtering correctly after a page reload; the icon next to active filter chips now opens the filter panel as expected; and cleared filters no longer reappear when returning to the same page.
• Column Order in Observe Grids Now Persists Across Refreshes: Reordering columns in Trace, Spans, Sessions, and Voice grids would silently reset to the original order on the next auto-refresh. Column order now sticks across refreshes, and the display panel stays in sync with any changes.
• Custom Prompt Evaluators Now More Reliable: In some cases, evaluation criteria that included output format instructions caused the evaluator to return no result. Evaluators now handle this reliably regardless of how the criteria are phrased.
• Nested Variable References Now Work in LLM-as-Judge Templates: Variables that reference nested properties using dot notation were not rendering correctly in custom prompt evaluator templates. They now resolve and render as expected.
• Fix with Falcon Now Only Appears on Failing Evals: The Fix with Falcon option previously appeared on both passing and failing eval rows. It now only appears on evals that are failing, not on every row.
• Resuming a Completed Eval Task Now Shows a Clear Message: In some cases, clicking Resume on a task that had already finished showed a raw error. It now shows a clear message indicating the task may have already completed.
• Instruction Validation Errors Now Visible When Creating Evals from Sessions: When adding an LLM-as-judge evaluation from the Sessions view, validation errors on the instructions field were not shown, causing saves to silently fail. Error messages now appear inline as expected.
• Eval and Task List Chips Now Have Hover Feedback and a Stable Popover: Chips in the Tasks and Evals list had no hover state, and the popover showing additional items closed as soon as the cursor moved toward it. Chips now darken on hover and the popover stays open as the cursor moves into it.
• Task Usage Table Columns No Longer Get Cut Off: The Task Usage table was clipping right-side columns. The table now scrolls horizontally so every column stays visible.

---

This discussion was created from the release Release notes — 2026-05-28.