Skip to content

v0.6.3

Choose a tag to compare

View all tags
@jrullan jrullan released this 22 Aug 13:00
· 523 commits to main since this release
v0.6.3
13907af

Queued runs: Two runs aimed at a one-slot local endpoint used to serialize invisibly at inference time; now the second run queues honestly, with a reason that names the provider and the runs holding its slot. The starter defaults work without any configuration: local endpoints cap at 1 concurrent run, hosted at 8, and an explicit max_concurrent overrides either. The cap also keeps you from tripping rate limits or overloading a hosted provider.

Queue status: Runs that are waiting now record the reason, and the desktop shows that reason, so you can see at a glance why a run hasn't started rather than guessing.

Settings: Each provider's maximum concurrent runs (max_concurrent) is now exposed in Settings, so you can view and adjust the cap per provider.

What shipped

M-001

  • T-096 Per-provider concurrency caps in the run queue with the reason recorded on the run (5e89bf7)
  • T-097 Show the queued reason in the desktop and expose provider max_concurrent in Settings (b8aff05)
Assets 2
Loading