Skip to content

Interface for per-asset-dep partition mapping? #57694

@dstandish

Description

@dstandish

Body

When setting dependencies on against asset partitions, we need to define a partition mapper so that we know how to translate from source partition key to target partition key in the event that the target may be partitioned in a different way. For example if the source is partitioned daily and the target is partitioned weekly.

When supporting multi-asset dependencies in the partitioning concept, should we allow each of them to have a different partition mapper?

Or should we require them all to have the same partitioning mapper? Should we require all of them to use the same partition scheme?

Committer

  • I acknowledge that I am a maintainer/committer of the Apache Airflow project.

Metadata

Metadata

Assignees

No one assigned

    Labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions