0.22.4

Major bug-fixes

Server stability

The server could stop responding in two cases, both fixed in this release. Opening SSH connections, e.g. for service probes, could crash in gRPC and hang the server for up to 5 minutes (#4362). Submitting many runs at once kept the server busy finding offers and unable to handle other requests (#4373); finding offers is now also much faster. In either case, cloud instances being created at the time could be left running without dstack tracking them.

UI

Launch

The Launch button on the Runs page now opens a page that shows how to start a run with the CLI or with AI agents using dstack skills.

Templates in the UI are now available only in dstack Enterprise, Factory, and Sky.

Offers

The Offers page now shows the best GPUs first, and its new Launch button takes you to the Launch page with the same filters.

Quotas

In dstack Factory and Sky, project admins can now see the project's quotas in a new Quotas tab and request an increase.

What's Changed

• Disable gRPC fork support in the server by @r4victor in #4365
• Speed up offer lookups and consume them off the event loop by @r4victor in #4374
• Fix preemptible Nebius L40S provisioning by @jvstme in #4367
• Rework router worker sync around job ID labels by @un-def in #4361
• Detect HTTP worker runtime via /v1/models by @un-def in #4368
• [UI] Rework Launch and Offers by @peterschmidt85 in #4369
• [UI] Add project quotas (Factory and Sky only) by @peterschmidt85 in #4370
• Rename router type sglang to smg by @un-def in #4371
• Build Azure community gallery image ID instead of looking it up by @peterschmidt85 in #4334
• Replace freezegun with time-machine by @r4victor in #4360
• Support SQLAlchemy 2.1 by @un-def in #4364

Full Changelog: 0.22.3...0.22.4