Skip to content

hive query on mor get empty result before compaction #15799

@hudi-bot

Description

@hudi-bot

when a mor table write data with flink cdc only, then before compaction the partition will only have log file, and no base file. then befor compaction, hive query result will always be empty.

it's because when hive getSplit on a native table, hive will ignore a partition which only has files start with '.', and because hudi has not set storageHandle when sync hive meta, then hive treat it as native table

!image-2023-02-15-20-48-08-819.png!

!image-2023-02-15-20-48-21-988.png!

JIRA info

Metadata

Metadata

Assignees

No one assigned

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions