Skip to content

0.9.3

Latest

Choose a tag to compare

@leoguillaume leoguillaume released this 17 Nov 09:28
· 28 commits to main since this release
223551e

This release adds provider concurrency controls and configurable admission retries to protect inference engines under load.
Deployment now requires an explicit migration step before starting the API.
Configuration loading becomes stricter, and auth_secret_key is mandatory: review secrets and environment variables before upgrading.
Migration fixes also bound lock waits and make database rollbacks safer.

Breaking changes

  • Run python -m alembic -c api/alembic.ini upgrade head once before deploying the API; containers no longer migrate on startup. Update existing Compose deployments with the new migrate service and dependency (#1380)
  • Set settings.auth_secret_key explicitly; the deprecated auth_master_key fallback is removed. Reuse its previous value to preserve existing API keys; changing the signing secret invalidates them (#1388)
  • Resolve environment variables after YAML parsing: missing or empty variables without defaults, and invalid ${...} names, now prevent API and playground startup. ${VAR:-} produces "", not null, and variables can no longer inject YAML structures (#1385)
  • Supply runtime-only variables as placeholders when building the playground with --build-arg BUILD_PLACEHOLDER_VARIABLES="NAME=placeholder"; never pass real secrets through this argument (#1385)
  • Check secrets previously truncated by YAML characters such as # or : : they are now read in full, which can change the signing secret and require recreating API keys (#1385)
  • Configure provider concurrency with qos_limit and router admission retries with qos_retries_before_reject; saturated requests return 503 with Retry-After. Admin provider and router PATCH bodies must include their respective new field or receive 422; use null to preserve unlimited admission (#1180)
  • Remove basic_auth from the POST /v1/admin/providers response; cancel model-forward requests when clients disconnect and record status 499 (#1180)
    Refactoring
  • Move provider-declared model schemas into the provider domain as ProviderModel / ProviderModels, without changing GET /v1/models (#1368)

Bug fix

  • Limit migration lock waits to five seconds so a blocked schema change fails instead of indefinitely queuing application traffic (#1372)
  • Generate named SQLAlchemy constraints so autogenerated Alembic downgrades can drop them reliably, without renaming existing constraints (#1377)
  • Delete unsupported PROVIDE_MODELS permissions during downgrade; permanently delete revoked keys rather than reactivating them, and rename duplicate key names before restoring uniqueness. Upgrading again does not restore deleted records (#1378, #1379)

Chore

  • Update Python security dependencies, including idna, Mako, Pygments, urllib3, and virtualenv (#1328)
  • Upgrade Gunicorn to 26.2.0, gevent to 26.9.0, Pydantic to 2.14.1, Reflex to 0.10.0, and refresh database, monitoring, and development dependencies (#1276, #1277, #1332)
  • Update documentation dependencies with security fixes, including Astro, Mermaid, DOMPurify, and Vite (#1333)
  • Check migration heads, model/schema consistency, and downgrade/upgrade execution against populated tables in the integration suite (#1374)
  • Keep uv.lock synchronized with release version bumps so locked installs and image builds remain reproducible (#1387)

Playground

  • Hide the sticky “Built with Reflex” badge (#1336)

Full Changelog: 0.9.1...0.9.3

  • ci(deploy): stop deploying Albert dev from OpenGateLLM by @benjaminpilia in #1330
  • chore(deps): bump the python-security group across 1 directory with 5 updates by @dependabot[bot] in #1328
  • chore(deps): bump the github-actions group across 2 directories with 4 updates by @dependabot[bot] in #1331
  • chore(deps): bump the python-minor-and-patch group across 1 directory with 7 updates by @dependabot[bot] in #1332
  • chore(deps): bump the docs-security group across 1 directory with 8 updates by @dependabot[bot] in #1333
  • feat(playground): hide the "Built with Reflex" badge by @tibo-pendino in #1336
  • fix(models): move a provider's declared models to the provider context by @benjaminpilia in #1368
  • ci(playground): stop building the Albert playground images in OGL by @benjaminpilia in #1344
  • chore(deps): bump gunicorn from 25.1.0 to 26.2.0 by @dependabot[bot] in #1276
  • chore(deps): bump gevent from 25.9.1 to 26.9.0 by @dependabot[bot] in #1277
  • fix(alembic): set a lock_timeout on the migration session by @benjaminpilia in #1372
  • ci(alembic): check the migrations on every pull request by @benjaminpilia in #1374
  • fix(alembic): add a naming convention to the SQLAlchemy metadata by @benjaminpilia in #1377
  • fix(alembic): delete the PROVIDE_MODELS permissions in the 85459163c6… by @benjaminpilia in #1378
  • fix(alembic): delete revoked keys and rename duplicates in the b7e4c1… by @benjaminpilia in #1379
  • feat(deployment)!: run the migrations once per deployment, not when a… by @benjaminpilia in #1380
  • feat(models): qos admission and limits by @leoguillaume in #1180
  • chore(doc): update generated documentation and release versions by @github-actions[bot] in #1305
  • ci(release): relock the project when the workflow bumps its version by @benjaminpilia in #1387
  • feat(config)!: interpolate the environment variables after parsing th… by @benjaminpilia in #1385
  • feat(config)!: make auth_secret_key mandatory and remove auth_master_key by @benjaminpilia in #1388
  • refactor(config): split the configuration module by section by @benjaminpilia in #1394
  • ci(build): label each api image with the Alembic head it expects by @benjaminpilia in #1401
  • chore(deps): bump the python-minor-and-patch group across 1 directory with 5 updates by @dependabot[bot] in #1364
  • feat(models): sort v1/models by model name by @lboitel in #1397
  • fix(config): validate only the configuration fields the playground build uses by @benjaminpilia in #1413
  • chore(deps): bump the github-actions group across 2 directories with 2 updates by @dependabot[bot] in #1407
  • chore(deps): bump the python-minor-and-patch group with 6 updates by @dependabot[bot] in #1408
  • refactor(config): split the playground configuration by section by @benjaminpilia in #1417
  • refactor(config): make Configuration the schema of the file by @benjaminpilia in #1419
  • fix(metrics): require an admin key on /metrics by @benjaminpilia in #1420
  • feat(limits): show users what they have used of each allowed model's rate limits by @bakr-a in #1334
  • docs(alembic): write down the migration authoring rules by @benjaminpilia in #1423
  • fix(langfuse): score kWh and kgCO2eq usage in metadata instead of tra… by @moscaale in #1400
  • chore(deps): bump rich from 14.3.4 to 15.0.0 by @dependabot[bot] in #1411
  • feat(auth): remove me/info endpoints and reject expired users by @lboitel in #1392
  • chore(doc): update generated documentation and release versions by @github-actions[bot] in #1337
  • docs(usage): document rate limits, token counts and cached tokens by @bakr-a in #1338
  • feat(playground): filter role and organization through search bar by @lboitel in #1421
  • fix(playground): clear the admin lists when a load fails or the user logs out by @tibo-pendino in #1349
  • ci(alembic): lint the SQL of the migrations a pull request adds, with… by @benjaminpilia in #1425
  • chore: update gitignore by @leoguillaume in #1427