Skip to content

v1.9.0

Latest

Choose a tag to compare

@datahub-release-bot datahub-release-bot released this 16 Nov 05:40
cbce986

v1.9.0

Release Availability Date

16 Nov 2026

Requirements

  • CLI / Python SDK: 1.7.0.19
  • Helm chart: 1.1.10

Upgrade actions are in Breaking Changes for v1.9.0.

Highlights

  • Metrics are on by default. METRICS_ENABLED now defaults to true, which turns on the Metrics page, the /metrics route, and the backend wiring for Metric and Semantic Model. v1.8.0 defaulted to false. Set METRICS_ENABLED=false to turn it off.
  • Google Drive source (Alpha). Ingests Google Docs from chosen folders and shared drives as Document entities, so they are searchable, including with semantic search.
  • datahub recipe probe. Checks what a recipe would ingest before a run. probe, test-connection, and validate now use exit code 2 for bad input, 3 for a source failure, and 1 for DataHub, the connector, or a missing package.
  • Elasticsearch 7.x is no longer supported. Use Elasticsearch 8.x, or OpenSearch 2.x or 3.x.
  • System client credentials go only to the configured server. A client created without a token sends DATAHUB_SYSTEM_CLIENT_ID and DATAHUB_SYSTEM_CLIENT_SECRET only to the server in DATAHUB_GMS_URL. UI-managed ingestion refuses recipes that would send them elsewhere.

Product

  • Child Applications appear in the parent Application's Assets tab. (#20420)
  • Group search ranks results by relevance instead of creation time. (#21073)
  • The schema filter menu and the default Navigate sidebar were fixed. (#21150)
  • A button label stays visible in Firefox after loading ends. (#21073)

Platform

  • Assertion status comes from the latest run across results. (#20954)
  • A race condition in reindexing is fixed. (#21073)
  • Concurrent sign-up or password reset no longer shares one hash digest across threads, so a corrupt password hash cannot be stored. (#21256)
  • Batch tag and glossary term writes keep every column's change, not just the last one. (#21256)
  • An aspect left unchanged by a write hook keeps its stored version and does not add a history row. (#21256)
  • datahub-upgrade -u Cleanup and -u LoadIndices start again. (#21256)
  • When the token store cannot be read, GMS returns 503 with Retry-After instead of 401. The delay is set by AUTH_UNAVAILABLE_RETRY_AFTER_SECONDS (default 3) plus up to AUTH_UNAVAILABLE_RETRY_AFTER_JITTER_PERCENT (default 50) percent. (#21256)
  • With separate producer and consumer Kafka settings, the admin client uses the producer security protocol and applies the MSK IAM configuration. (#21256)
  • Sliced scroll reuses the point-in-time across pages, and cached search handlers are isolated by field metadata. (#21256)

Ingestion

  • The UI-managed ingestion executor validates extra_pip_requirements before it installs them. (#21203)
  • The ingestion framework runs on SQLAlchemy 2.0. acryl-datahub requires click>=8.3.3 and anyio>=4.14.2.
  • DataHub Lite uses SQLite for new instances. DuckDB is a separate extra.
  • The hive and presto sources no longer use PyHive.

Security

Deprecations

  • Audit stamps that only repeat the DataHub write are deprecated in favor of systemMetadata.aspectCreated and systemMetadata.aspectModified. The old fields remain and are still indexed.
  • GET /admin and GET /health on the Play port (9002) are deprecated as health checks. They still return 200 GOOD, or 503 during graceful shutdown.

Breaking Changes

The full list, with actions, is in Breaking Changes for v1.9.0. The main changes are:

  • Authorization. Changing an entity's platform instance or domain is checked against both the old and the new value. Assertion APIs apply the same asset-level permissions as the UI. Scheduling an ingestion source requires permission. Invite tokens that assign a role require Manage User Credentials and Manage Policies. Privilege-constraint denials on tags and structured properties return 403 instead of 400.
  • Search. Elasticsearch 7.x is removed. Search V3 keyword scoring, default query fields, indexed fields, and the lineage and browse templates changed. Timeseries indices refresh every 60 seconds by default.
  • Hard rollback. The UI Rollback button and datahub ingest rollback --nuke no longer delete an entity once another run or a user has written to it.
  • Conditional writes. If-Version-Match and If-Modified-Since apply to generic JSON patches.
  • Ingestion. Airflow plugin datasets use the same URNs as the S3, GCS, and Azure Blob sources, so lineage recorded under old URNs stays on the old datasets. dbt manifest_path treats *, ?, [, and ] as glob characters, and semantic models are no longer modeled as warehouse tables. Sigma runs fail when an entity listing fails. The profiling config classes lost their GE prefix.
  • CLI. datahub recipe commands return the exit codes above. The cloud pip extra was removed from acryl-datahub.
  • Logging and startup. GMS no longer writes DEBUG logs to gms.debug.log by default. GMS, MAE, and MCE no longer wait on the DataHubUpgradeHistory_v1 marker.

Full Changelog: v1.8.0...v1.9.0