0.22.2

Backends

Daytona

dstack now supports Daytona as a backend for CPU and GPU dev environments, tasks, and services, including multi-GPU configurations with NVIDIA and AMD GPUs.

$ dstack offer -b daytona --gpu B300,MI355X,H200:1..8 --max-offers 3

 #  BACKEND          RESOURCES                                     INSTANCE TYPE           PRICE
 1  daytona (earth)  cpu=x86:1 mem=1GB disk=1GB gpu=H200:141GB:1     1x-H200-1cpu-1gb-1gb    $4.6067
 2  daytona (earth)  cpu=x86:1 mem=1GB disk=1GB gpu=MI355X:288GB:1   1x-MI355X-1cpu-1gb-1gb  $6.0567
 3  daytona (earth)  cpu=x86:1 mem=1GB disk=1GB gpu=B300:270GB:1     1x-B300-1cpu-1gb-1gb    $7.1667
    ...
 Shown 3 of 19 offers, $47.986708max

dstack’s Daytona integration also supports volumes. Daytona provides these as S3-backed FUSE mounts, allowing multiple instances to mount the same volume simultaneously across regions.

See the backend documentation for configuration and required permissions.

Presets

Replica groups

Preset creation now uses a separate router for regular inference as well as prefill-decode disaggregation when the fleet has placement: cluster and a CPU-only instance for the router.

Trials use task node groups, and the final service uses replica groups to run the router and GPU workers separately. Workers connect over gRPC when supported, and all benchmarks run through the router.

What's Changed

• Refactor dstack for dstack Factory extension by @r4victor in #4303
• [Website] Updated product pages by @peterschmidt85 in #4304
• Fix GCP a3-edgegpu-8g and a3-highgpu-8g by @jvstme in #4307
• Fix errors in service router worker sync by @un-def in #4305
• Clarify Kubernetes volume context selection by @peterschmidt85 in #4311
• [Website] Updated Slurm info on landing by @peterschmidt85 in #4312
• Set upper bound of SQLAlchemy version to < 2.1 by @un-def in #4314
• Don't require probes to pass in router worker sync by @un-def in #4313
• Polish landing pages by @peterschmidt85 in #4319
• OCI: resolve availability domains from the configured compartment by @fede-kamel in #4309
• Sync workers with every running router by @un-def in #4320
• Restore model probe for service routers by @un-def in #4322
• [Presets] Update system_prompt for router usage by @Bihan in #4294
• Parse Crusoe quota counters returned as strings by @r4victor in #4323
• [UI] Fix job metrics tab by @un-def in #4324
• Disable gateway proxy buffering for model services by @r4victor in #4326
• Apply DSTACK_SERVICE_CLIENT_TIMEOUT to gateway nginx and app by @r4victor in #4327
• Add Daytona backend by @peterschmidt85 in #4321
• Pin Nebius spot price at provisioning time by @jvstme in #4328
• Add OCI experimental_instance_types setting by @jvstme in #4329

New Contributors

• @fede-kamel made their first contribution in #4309

Full Changelog: 0.22.1...0.22.2