Skip to content

0.22.1

Latest

Choose a tag to compare

@un-def un-def released this 17 Sep 14:13
06d8dc4

Gateways

GCP

GCP gateways with an ALB can now use certificates managed by Google Cloud Certificate Manager, enabling HTTPS for services behind the gateway with TLS terminated at the load balancer:

type: gateway
name: example-gateway
backend: gcp
region: europe-west4
domain: example.com
replicas: 2
load_balancer:
  type: alb
certificate:
  type: gcp-cm
  name: projects/my-project/locations/europe-west4/certificates/my-certificate

The certificate must be a regional certificate created in the same region as the gateway, referenced by its full resource name. Creating such gateways requires additional GCP permissions:

certificatemanager.certs.use
compute.regionTargetHttpsProxies.create
compute.regionTargetHttpsProxies.delete
compute.regionTargetHttpsProxies.use

Refer to the docs for details.

Replicas

The maximum number of gateway replicas is raised from 3 to 9, and is now configurable server-wide via DSTACK_SERVER_GATEWAY_MAX_REPLICAS.

Replicated gateways are no longer marked experimental. The remaining limitation is that automatic certificate issuance via Let's Encrypt is not supported for them — use acm, gcp-cm, or an external load balancer for TLS termination.

Presets

Public registry

Presets in the dstack Sky registry are private by default and can now be made public. Set Presets to Public in the project settings to let anyone browse and pull the project's presets without signing in, including users of a self-hosted dstack server:

$ dstack preset pull main/qwen38-27b-mi300x
OK

Only project admins and global admins can change this setting; enabling it does not let anyone join the project.

What's changed

  • [UI] Project visibility: minor UX changes by @peterschmidt85 in #4284
  • [runner] Terminate the job's whole session, not just its shell by @un-def in #4283
  • [runner] Make the executor lifecycle explicit by @un-def in #4286
  • Fix gRPC router workers never becoming ready with model set by @Bihan in #4270
  • Add DB index for instance_health_checks by @r4victor in #4288
  • [Presets] Support public presets by @peterschmidt85 in #4287
  • Collect the last job logs before killing the container by @un-def in #4289
  • Improve DB connections handling by @r4victor in #4291
  • Prevent resuming a saved preset by @ZenAlexa in #4228
  • Support Certificate Manager for GCP gateways by @jvstme in #4290
  • Increase gateway replica count limit 39 by @jvstme in #4295
  • Treat pre-releases as final releases in feature gates by @un-def in #4296
  • Fix model endpoint protocol with LB-terminated TLS by @jvstme in #4299
  • Do not downgrade runner and shim by default by @un-def in #4297
  • Discourage automatic PRs by autonomous agents by @jvstme in #4292

New contributors

Full changelog: 0.22.0...0.22.1