-
Notifications
You must be signed in to change notification settings - Fork 16.3k
Open
Labels
area:dynamic-task-mappingAIP-42AIP-42kind:metaHigh-level information important to the communityHigh-level information important to the community
Description
Body
When setting dependencies on against asset partitions, we need to define a partition mapper so that we know how to translate from source partition key to target partition key in the event that the target may be partitioned in a different way. For example if the source is partitioned daily and the target is partitioned weekly.
When supporting multi-asset dependencies in the partitioning concept, should we allow each of them to have a different partition mapper?
Or should we require them all to have the same partitioning mapper? Should we require all of them to use the same partition scheme?
Committer
- I acknowledge that I am a maintainer/committer of the Apache Airflow project.
Metadata
Metadata
Assignees
Labels
area:dynamic-task-mappingAIP-42AIP-42kind:metaHigh-level information important to the communityHigh-level information important to the community