Skip to content

[HUDI-7068] Disable vectorized reader for hoodie filegroup reader when schema isn't supported#10043

Merged
yihua merged 1 commit intoapache:masterfrom
jonvex:vectorized_test_for_new_reader
Nov 10, 2023
Merged

[HUDI-7068] Disable vectorized reader for hoodie filegroup reader when schema isn't supported#10043
yihua merged 1 commit intoapache:masterfrom
jonvex:vectorized_test_for_new_reader

Conversation

@jonvex
Copy link
Contributor

@jonvex jonvex commented Nov 9, 2023

Change Logs

set "spark.sql.parquet.enableVectorizedReader" based on support batch

Impact

prevent failure

Risk level (write none, low medium or high below)

low

Documentation Update

N/A

Contributor's checklist

  • Read through contributor's guide
  • Change Logs and Impact were stated clearly
  • Adequate tests were added if applicable
  • CI passed

@yihua yihua added priority:blocker Production down; release blocker release-1.0.0 labels Nov 9, 2023
@jonvex jonvex force-pushed the vectorized_test_for_new_reader branch from 0ac4735 to c57f584 Compare November 9, 2023 21:49
@jonvex jonvex force-pushed the vectorized_test_for_new_reader branch from c57f584 to ee90b6b Compare November 10, 2023 04:02
@jonvex jonvex changed the title [HUDI-0000] Vectorized test for new reader [HUDI-7068] Disable vectorized reader for hoodie filegroup reader when schema isn't supported Nov 10, 2023
@hudi-bot
Copy link
Collaborator

CI report:

Bot commands @hudi-bot supports the following commands:
  • @hudi-bot run azure re-run the last Azure build

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

priority:blocker Production down; release blocker release-1.0.0

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants