You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
{{ message }}
This repository has been archived by the owner on Jun 14, 2024. It is now read-only.
For each index record, add lineage to capture the data record it is coming from. Assume data records are organized in Hive partitioned manner, where all the records which have the same value for a given partitioning key are stored in files under the same directory whose name has PartitionKey=VALUE. By adding lineage to index records, we want to add extra columns to each record and store the value of partition key(s) and file name according to the data file a record is coming from.
To Reproduce
N/A
Expected behavior
Once an index is created successfully, each index record should have columns to capture its source data record's partition key(s"' values and data file name.
Environment
All environments.
The text was updated successfully, but these errors were encountered:
Describe the issue
For each index record, add lineage to capture the data record it is coming from. Assume data records are organized in Hive partitioned manner, where all the records which have the same value for a given partitioning key are stored in files under the same directory whose name has
PartitionKey=VALUE
. By adding lineage to index records, we want to add extra columns to each record and store the value of partition key(s) and file name according to the data file a record is coming from.To Reproduce
N/A
Expected behavior
Once an index is created successfully, each index record should have columns to capture its source data record's partition key(s"' values and data file name.
Environment
All environments.
The text was updated successfully, but these errors were encountered: