Skip to content

feat: Make Hook Level Lineage limits configurable#62010

Merged
mobuchowski merged 1 commit intoapache:mainfrom
kacpermuda:feat-hll-limit-config
Feb 17, 2026
Merged

feat: Make Hook Level Lineage limits configurable#62010
mobuchowski merged 1 commit intoapache:mainfrom
kacpermuda:feat-hll-limit-config

Conversation

@kacpermuda
Copy link
Contributor

Currently MAX_COLLECTED_ASSETS and MAX_COLLECTED_EXTRA are hardcoded limits for hook lineage collectors. This PR makes them configurable with Airflow configuration. Users that want more detailed lineage can increase those limits and users that do not want any hook lineage can disable it by setting those limits to 0.


Was generative AI tooling used to co-author this PR?

No


  • Read the Pull Request Guidelines for more information. Note: commit author/co-author name and email in commits become permanently public when merged.
  • For fundamental code changes, an Airflow Improvement Proposal (AIP) is needed.
  • When adding dependency, check compliance with the ASF 3rd Party License Policy.
  • For significant user-facing changes create newsfragment: {pr_number}.significant.rst or {issue_number}.significant.rst, in airflow-core/newsfragments.

@kacpermuda kacpermuda force-pushed the feat-hll-limit-config branch from 0ab6476 to b7a220f Compare February 16, 2026 12:52
@kacpermuda kacpermuda force-pushed the feat-hll-limit-config branch from b7a220f to 050c3c8 Compare February 16, 2026 13:15
Copy link
Contributor

@amoghrajesh amoghrajesh left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks! LGTM

@kacpermuda
Copy link
Contributor Author

Ready to merge @amoghrajesh ? Do you think we should backport it to 3.1 as well ? Seems like a small feature that can be useful, not sure how tough it is to backport.

@mobuchowski
Copy link
Contributor

I'll merge this :)

@mobuchowski mobuchowski merged commit dc1baec into apache:main Feb 17, 2026
101 checks passed
@kacpermuda kacpermuda deleted the feat-hll-limit-config branch February 17, 2026 14:50
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants