-
Notifications
You must be signed in to change notification settings - Fork 2.5k
Closed
Labels
engine:flinkFlink integrationFlink integrationfrom-jirapriority:highSignificant impact; potential bugsSignificant impact; potential bugsstatus:pr-availablePull request availablePull request availabletype:bugBug reports and fixesBug reports and fixes
Description
when a mor table write data with flink cdc only, then before compaction the partition will only have log file, and no base file. then befor compaction, hive query result will always be empty.
it's because when hive getSplit on a native table, hive will ignore a partition which only has files start with '.', and because hudi has not set storageHandle when sync hive meta, then hive treat it as native table
!image-2023-02-15-20-48-08-819.png!
!image-2023-02-15-20-48-21-988.png!
JIRA info
- Link: https://issues.apache.org/jira/browse/HUDI-5805
- Type: Bug
- Attachment(s):
- 15/Feb/23 12:48;lrz;image-2023-02-15-20-48-08-819.png;https://issues.apache.org/jira/secure/attachment/13055471/image-2023-02-15-20-48-08-819.png
- 15/Feb/23 12:48;lrz;image-2023-02-15-20-48-21-988.png;https://issues.apache.org/jira/secure/attachment/13055470/image-2023-02-15-20-48-21-988.png
Reactions are currently unavailable
Metadata
Metadata
Assignees
Labels
engine:flinkFlink integrationFlink integrationfrom-jirapriority:highSignificant impact; potential bugsSignificant impact; potential bugsstatus:pr-availablePull request availablePull request availabletype:bugBug reports and fixesBug reports and fixes