Skip to content

Add asset partition sensor#67941

Draft
Leondon9 wants to merge 2 commits into
apache:mainfrom
Leondon9:codex/asset-partition-sensor
Draft

Add asset partition sensor#67941
Leondon9 wants to merge 2 commits into
apache:mainfrom
Leondon9:codex/asset-partition-sensor

Conversation

@Leondon9
Copy link
Copy Markdown
Contributor

@Leondon9 Leondon9 commented Jun 3, 2026

Add a small server-side partition lookup for asset events and a standard provider sensor that can wait for a specific asset partition from a time-scheduled DAG.

What changed:

  • Added partition_key exact filtering to Execution API asset event lookups by asset and by asset alias.
  • Threaded partition_key through the Task SDK client, comms models, task supervisor, triggerer supervisor, and inlet event accessor.
  • Added AssetPartitionSensor and AssetPartitionTrigger in the standard provider.
  • Added focused tests for the API filter, SDK forwarding path, sensor, and trigger behavior.

This is intended as a narrow draft for the idea in #67375. It deliberately avoids broader pattern/regex filters, Core API expansion, DB migrations/indexes, UI changes, and generated OpenAPI churn. It overlaps with part of #64610 only in the exact partition lookup surface; if #64610 lands first, this branch should be rebased and the lookup commit can likely be dropped or reduced.

Validation:

  • prek run ruff-format --files ...
  • prek run ruff --files ...

Pytest was attempted with Breeze, but the local test bootstrap failed before collecting/running the changed tests due provider discovery/import setup issues (airflow.providers.akeyless) and task_sdk import setup in the container.

related: #67375


Was generative AI tooling used to co-author this PR?
  • Yes — Codex (GPT-5)

Generated-by: Codex (GPT-5) following https://github.com/apache/airflow/blob/main/contributing-docs/05_pull_requests.rst#gen-ai-assisted-contributions

@Leondon9 Leondon9 force-pushed the codex/asset-partition-sensor branch from e0b2c41 to 5b85614 Compare June 3, 2026 12:33
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant