Skip to content

[HUDI-8104] fix Hive on spark select mor rt table, org.apache.hudi.hadoop.hive.HoodieCombineRealtimeFileSplit cannot be cast to org.apache.hadoop.hive.shims.HadoopShimsSecure#11799

Merged
danny0405 merged 1 commit intoapache:masterfrom
felixzh2020:HUDI-8104
Aug 21, 2024

Conversation

@felixzh2020
Copy link
Contributor

@felixzh2020 felixzh2020 commented Aug 20, 2024

…imeFileSplit cannot be cast to org.apache.hadoop.hive.shims.HadoopShimsSecure

Change Logs

The reason for the error is
HoodieParquetRealtimeInputFormat's job not set correctly hudi.hive.realtime

Impact

Describe any public API or user-facing feature change or any performance impact.

Risk level (write none, low medium or high below)

If medium or high, explain what verification was done to mitigate the risks.

Documentation Update

Describe any necessary documentation update if there is any new feature, config, or user-facing change. If not, put "none".

  • The config description must be updated if new configs are added or the default value of the configs are changed
  • Any new feature or user-facing change requires updating the Hudi website. Please create a Jira ticket, attach the
    ticket number here and follow the instruction to make
    changes to the website.

Contributor's checklist

  • Read through contributor's guide
  • Change Logs and Impact were stated clearly
  • Adequate tests were added if applicable
  • CI passed

…imeFileSplit cannot be cast to org.apache.hadoop.hive.shims.HadoopShimsSecure
@hudi-bot
Copy link
Collaborator

CI report:

Bot commands @hudi-bot supports the following commands:
  • @hudi-bot run azure re-run the last Azure build

@github-actions github-actions bot added the size:XS PR with lines of changes in <= 10 label Aug 20, 2024
@danny0405 danny0405 added the engine:hive Hive integration label Aug 20, 2024
@danny0405 danny0405 merged commit b6bad40 into apache:master Aug 21, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

engine:hive Hive integration size:XS PR with lines of changes in <= 10

Projects

Status: ✅ Done

Development

Successfully merging this pull request may close these issues.

3 participants