Skip to content

v0.5.48

Choose a tag to compare

@SushantGautam SushantGautam released this 06 Nov 21:06
· 4 commits to main since this release

Highlights

Large runs no longer stall (#82). Scenarios waiting in the queue for a free worker slot no longer expire. Hatchet's default 5-minute scheduling timeout used to fail every scenario of a large run that had not started within 5 minutes of submission, so runs with more scenarios than worker slots stopped part-way with no error. The scenario task now waits as long as needed; a resubmitted scenario still never runs twice at once.

Failed spans show why they failed (#80). With SimpleAudit 0.6, Studio stores each span's status message and exception events. For a failed tool call the judge now sees status: ERROR and exception: <type>: <message>, and the run timeline's Error block shows the same.

  • At every capture level only the exception type and message are kept; stack traces and other span events need full capture.
  • Spans stored before this release keep showing their error as before.

Upgrade note: includes the migration model_registry.0022 (two new columns on stored spans, no data changes). Restart the worker together with the web process.