Skip to content

OpenLineage 1.39.0

Choose a tag to compare

View all tags
@mobuchowski mobuchowski released this 15 Oct 08:32
· 553 commits to main since this release
1.39.0
This tag was signed with the committer’s verified signature.
mobuchowski Maciej Obuchowski
SSH Key Fingerprint: 6RlAEhuCK12zTI6kzMa0z/oG635y5AAwGE4B1+RW6J4
Verified
Learn about vigilant mode.
4e4a918
This commit was signed with the committer’s verified signature.
mobuchowski Maciej Obuchowski
SSH Key Fingerprint: 6RlAEhuCK12zTI6kzMa0z/oG635y5AAwGE4B1+RW6J4
Verified
Learn about vigilant mode.

Added

  • Spark: Normalize dataset names with configurable trimmers #3996 @pawel-big-lebowski
    Add configurable dataset name normalization with support for date patterns, key-value pairs, and S3 location detection to enable proper dataset subsetting.
  • Spark: Add missing facets in inputs for Databricks Unity Catalog #4057 @kchledowski
    Add missing input symlink facets for Databricks Unity Catalog tables.

Changed

  • Spark: Refactor tests for dependency collector #4058 @kchledowski
    Refactor column-level lineage dependency collector tests for better organization and maintainability.

Fixed

  • Spec: Fix typo in iceberg commit report facet spec file #4069 @fm100
    Fix typo in IcebergCommitReportOutputDatasetFacet property name.
  • Spark: Fix dataset trimming for CLL inputs #4061 @pawel-big-lebowski
    Fix dataset name trimming for column-level lineage inputs.
  • Python: Remove numpy import #4062 @kacpermuda
    Remove unnecessary numpy import from Python client.

Removed

  • Dagster: Remove Dagster integration #3844 @kacpermuda
    Remove Dagster integration from the repository.
Assets 2
Loading