Skip to content

26.10.0a11

Pre-release
Pre-release

Choose a tag to compare

@github-actions github-actions released this 19 Nov 06:56
· 21 commits to main since this release
e2a954b

Breaking Changes

  • Remove generate-example-configuration from the App Proxy coordinator and App Proxy worker in favor of config generate-sample, and correct the permit_hash.digest_mod and proxy_worker.accepted_traffics examples that ServerConfig rejected (#16444)
  • Remove PATCH /auth/ssh-keypair, the only API that generated an SSH keypair on the server and returned its private key; create a keypair on the client and register its public key with POST /auth/ssh-keypair (#17108)
  • Stop generating an SSH keypair when a user is created, so a new user has no SSH keypair until they register a public key (#17109)
  • Reject a Harbor webhook for a container registry that has no webhook_auth_header in its extra; set the same value as the Auth Header of the Harbor webhook policy and as extra.webhook_auth_header of the registry to keep receiving webhooks (#17155)

Features

  • Add a Traefik app-proxy dataplane option to the TUI installer via a new --proxy-backend=traefik flag that composes with both --frontend-mode=port and --frontend-mode=wildcard traffic patterns (--frontend-mode=traefik remains as a deprecated alias for the port pattern): Traefik runs as a halfstack compose service (profile traefik) with the appproxy Traefik plugin, the installer generates the matching entrypoint set (the portproxy range, or the domainproxy wildcard entrypoint), and the coordinator/worker configurations are generated accordingly. (#12749)
  • Let a plugin command under the agent or manager CLI group read the group's config path without importing that component's CLI context. (#15372)
  • Take designated agents in the deployment create and update inputs, refusing agents outside the deployment's resource group (#15933)
  • Refuse a session enqueue that designates an agent not registered in agents (#15983)
  • Generate each component's config sample as a Jinja template (sample.toml.j2) with a named argument per entry key, and add config render to write a configuration file from it (#15985)
  • Let the agent read the volumes it holds from Redis and check the status of each, following the declarations as they change. (#16335)
  • Promote auto-generated files to entities owned by their user, with the per-owner file limit checked on create (#16361)
  • Expose a resource group's scheduler options on the V2 ResourceGroup type under scheduler.options (#16368)
  • Let adminCreateResourceGroupV2 set a resource group's active and public flags and its scheduler type (#16377)
  • Add actions that search the relations between domains and container registries, within the named domains or across all of them (#16992)
  • Add a scoped search of container registries over the domains they are related to (#17001)
  • Add the DomainV2.containerRegistries connection and the operations that create and purge relations between domains and container registries, and fill the relations from each domain's allowed_docker_registries (#17113)
  • Let a model service in a deployment revision and revision preset choose the delimiters that mark variables in its service arguments, defaulting to ${{ }} and { } (#17138)
  • Decide container registry access in session creation, the scheduler's image check and the legacy image queries from the domain's container registry relations, and seed the default domain's relations (#17151)
  • Let the v2 start-service API of a session choose the delimiters that mark variables in the service arguments, defaulting to ${{ }} and { } (#17205)
  • Forward the request ID header from the manager to the App Proxy coordinator so coordinator logs carry the request ID of the manager request that called it (#17216)
  • Add REST, SDK and CLI scoped search of the container registries a domain is related to (#17219)
  • Add trace-db-statements to the [otel] config so the manager records a span for each SQL statement it runs (#17227)

Improvements

  • Apply the deployment policy's current max_surge / max_unavailable to every rolling update, so a policy change takes effect on the next rollout of an existing deployment (#15579)
  • Let the kernel runner take the interpolation delimiters for service commands and pre-start action args per service start, keeping the legacy syntax unless delimiters are given (#15965)
  • Register, update and remove the AppProxy worker frontend backends by Ingress, converting each circuit to an Ingress once in the worker server, and look up a request's Ingress before its backend (#16352)
  • Type the user, project and deployment ids and the existing_url of the AppProxy coordinator endpoint tags instead of carrying them as strings, and answer an unusable existing_url with 400 (#16395)
  • Give session matching and the duplicate-name check on session create, enqueue and rename their own queries (#16426)
  • Read the revisions and the policy of the deployment reads with their own queries instead of the endpoint row relationships (#16996)
  • Move the kernel status set constants to KernelStatus, so a vfolder mounted only by a kernel in ERROR can now be purged (#17005)
  • Reject a container registry URL whose host cannot be read in the v2 create and update requests (#17020)
  • Move HookPluginContext to ai.backend.common.plugin.hook_context so that changing it no longer selects every scenario component (#17082)
  • Move KernelCreationConfig out of common/types.py into common/kernel_creation_config.py so changing it no longer selects every scenario component. (#17083)
  • Move InvalidContainerRegistryURL to common/errors/container_registry.py so adding an exception no longer selects every test that imports common/exception.py (#17091)
  • Run tests/unit/common test files in batched pytest processes. (#17098)
  • Move Prometheus error classes from common/exception.py to common/errors/prometheus.py. (#17101)
  • Move placeholder constants, the wheelhouse loader and bgtask errors into their own modules so a change to them selects fewer tests (#17102)
  • Move the scenario valkey fixture from the root conftest into the component conftests that use it, so a Valkey client change selects fewer scenario components. (#17110)
  • Move the action spec symbols out of manager/actions/types.py into manager/actions/spec.py. (#17111)
  • Move the role, permission field, virtual entity and global entity errors out of manager/errors/permission.py into their own modules. (#17114)
  • Keep the content of a user's auto-generated file as revisions, so an update adds a revision instead of overwriting the content (#17126)
  • Read the policy of a deployment search in the same read transaction as the page, instead of through the endpoint row's policy relationship (#17141)
  • Read the main kernels of deployment routes through the session scope in the same read transaction as the routes, instead of a kernel row method (#17145)
  • Build the model service EndpointData with Searchers for the revision, image, user emails and routes, instead of through the endpoint row relationships (#17150)
  • Move auto-generated file access from UserRepository into a dedicated AutoGeneratedFileRepository (#17154)
  • Read the kernel of a terminating-kernel broadcast through the scheduler repository in the stream cleanup event handler, instead of a kernel row method (#17158)
  • Add a PartialRecord base for results that hold only the fields a request selected (#17163)
  • Store domain and project dotfiles as auto-generated files and serve the domain-config and group-config dotfile APIs through the auto-generated file actions (#17164)
  • Remove unused manager methods and the legacy resource group RBAC path that depended on ORM rows (#17165)
  • Compute the kernel used time and used days in resource usage parsing instead of a kernel row property (#17166)
  • Ban pydantic v1 validators and sqlalchemy.ext.declarative with ruff banned-api (#17182)
  • Enable ruff rules UP043, PLR5501, PLR1730, PLW0120, PLW1510, PLR1711, PLC1802, FAST, ICN and YTT and apply their autofixes. (#17183)
  • Enable ruff TRY201 and TRY203 and remove redundant re-raises. (#17185)
  • Enable the ruff PGH004 rule and remove bare # noqa comments. (#17186)
  • Reject unselected (MISSING) response DTO fields as GQL field errors instead of leaking them (#17190)
  • Add the bootstrap script current-revision read operation, and align the bootstrap script processor names with the adapter naming rule (#17218)
  • Fail the migration check when a pull request adds a manager alembic migration without a # Part of: comment (#17220)

Fixes

  • Refuse a project roster assignment naming a role that is not an active role of the project, so a role of another project or domain can no longer be attached (#16605)
  • Keep a retried kernel create, or one its destroy overtook, from leaving a code runner socket that takes the replies of the next kernel at the same address (#16710)
  • Read the domain host grants in the vfolder host check: a personal folder unions the domain with the keypair resource policy, and a project folder unions the domain with the project. The upload session, download, clone, trash, purge and force-delete checks read the domain too. A project folder no longer takes a host the keypair resource policy alone grants; grant it on the project or the domain (#16726)
  • Reject an import request for an artifact revision that is still being imported, which could leave the archived model with only some of its files (#16730)
  • Bound the legacy GraphQL model card, session dependency, accessible resource group, agent summary and project member queries to what the requester may read (#16826)
  • Fix model service creation accepting a model folder that is in the trash or deleted (delete-pending, delete-ongoing, delete-complete, delete-error), by id or by a name it shares with a live folder (#16979)
  • Fix creating a session with a vfolder mount given by name failing when a deleted folder or another user's folder has the same name (#16981)
  • Stop counting a client that closes the connection before the proxied response is written as a manager failure, so the webserver no longer takes a healthy manager out of rotation (#16995)
  • Show the model-store project to a regular member in the legacy groups query when the request asks for it, and reject an unknown project type as an invalid request (#16999)
  • Let session ssh and session scp sign in with the user's own SSH key when the session holds no private key, and pass extra scp options before the paths (#17021)
  • Update the user dotfile component tests to the default-file behavior of created dotfiles. (#17087)
  • Cache the Pants launcher in CI and retry its download for longer, so a transient 504 no longer fails the Bootstrap Pants step. (#17088)
  • Import HookPluginContext from its new module in the component conftests that #17086 added (#17100)
  • Give every AppProxy error class an HTTP status, so a server fault raised while handling a request answers with 500 instead of the status line HTTP/1.1 -1 (#17125)
  • Answer with 500 for a BackendAIError whose class inherits no aiohttp HTTP status type, instead of the status line HTTP/1.1 -1 (#17129)
  • Keep collecting process stats on an agent when Docker reports one container's process list as null (#17130)
  • Give every raised error class in the agent, common, manager and storage packages an HTTP status, such as 403 for forgetting, purging or untagging an image the user does not own, instead of the status line HTTP/1.1 -1 (#17132)
  • Fix the client session so each wrapped SSL transport calls its own original connection_lost and eof_received callbacks (#17177)
  • Propagate cancellation instead of recording it as a failure during bulk endpoint creation, URL persistence and deletion in the deployment executor (#17181)
  • Log a deployment config file read failure in the deployment storage source before skipping the file. (#17187)
  • Raise HookHandlerFailed (500) with the original exception chained when a hook plugin handler raises an unexpected exception, instead of answering RejectedByHook (400) with the exception text (#17194)
  • Load the keypair auth hook's secret at startup and fail startup when it is missing instead of failing every sToken login with TypeError, and require explicit allow for the keypair plugins (#17211)
  • Remove the mgr auth CLI group that pointed to a deleted module and failed with an import error. (#17217)
  • Exclude the aiomonitor stubs from the python distributions so the release wheel build finds no owner error (#17224)

Documentation Updates

  • State in the test guide that manager components with scenario tests get no new component tests (#17107)
  • Add BEP-1082 for reading only the requested fields through a per-entity QuerySpec (#17171)
  • Reorder the BEP-1082 implementation steps into base types, pilots, and per-domain replacement (#17173)
  • Describe how BEP-1080 represents group keys not in groupBy in each result layer (#17179)
  • Document that FK filters on the searched or owned rows are filters and linked holds only relations whose FK sits on the other entity (#17189)

External Dependency Updates

  • Bump dnspython to 2.9.2, OpenTelemetry to 1.45.2 and tornado to 6.6.1 to clear reported CVEs (#17135)
  • Bump pydantic to 2.14.3 and mypy to 2.4.1 (#17169)

Miscellaneous

  • Make a newly created user dotfile the default of its path so it is read back and written into new sessions (#17000)
  • Drop the tables a manager models and actions unit test does not use from its with_tables list (#17089)
  • Move populate_fixture and its helpers from models/base.py to models/fixture.py. (#17090)
  • Move with_global_entities out of testutils/db.py so changing it no longer selects every test that uses with_tables. (#17099)
  • Keep the extra source paths of session scp in place when its extra options move before the paths (#17149)
  • Type the GQL resolver and CLI command decorators so that the functions they wrap keep their signatures (#17170)
  • Add the QuerySpec and QueryColumn base types alongside the existing search field declarations (#17174)
  • Let searchers and queriers read only the requested columns into a PartialRecord (#17175)
  • Enable ruff PGH003 and replace bare type: ignore comments with typed fixes (#17178)
  • Enable ruff TRY400 and TRY401 and log caught exceptions with logging.exception (#17180)
  • Add PartialRecord.or_missing to pass unselected fields to response DTOs as MISSING (#17188)
  • Remove the uncalled container registry usage of domain container registry relations in favor of the own filter (#17192)
  • Add an import-linter contract that forbids manager DTOs from importing ORM rows. (#17193)
  • Use the common pydantic DTOs for the manager artifact REST API and reservoir delegation (#17200)
  • Move the known container registry query out of ContainerRegistryRow into the container registry repository (#17210)

Test Updates

  • Isolate the agent config-loader test from BACKEND_NAMESPACE. (#15322)
  • Remove unused manager unit test fixtures and move the domain factory fixture to the repository tests so a change to it selects fewer tests. (#17081)
  • Move the etcd and valkey test fixtures next to the tests that use them so unrelated changes no longer select all unit tests. (#17084)
  • Move the scenario verdicts that one to a few components use out of the shared answers.py into one module each. (#17085)
  • Narrow the component tests a change to the auth_processors or acting_superadmin fixture selects to the directories that use them. (#17086)
  • Drop with_tables entries that the repository tests of notification through resource_usage_history do not use. (#17092)
  • Remove component tests that scenario tests replace and move the DB-less web and agent tests to unit (#17093)
  • Remove unit test fixtures that no test requests, so a change to their conftest selects fewer tests. (#17094)
  • Drop the unused tables from the retention to vfolder repository tests' with_tables lists so changing those models no longer selects them. (#17095)
  • Drop with_tables entries that repositories agent to model_card tests do not use (#17096)
  • Narrow the component tests a change to a fixture used by one test file selects to that file. (#17097)
  • Split the seed unit test fixtures and idempotence tests into the kind directories so a change to one kind's fixture selects only that kind's tests. (#17112)
  • Enable the ruff RUF059 rule and prefix unused unpacked variables with an underscore. (#17176)
  • Check four layer import contracts with import-linter in the CI lint step. (#17184)

Full Changelog

Check out the full changelog until this release (26.10.0a11).

Full Commit Logs

Check out the full commit logs between release (26.10.0a9) and (26.10.0a11).