Skip to content

[HUDI-7479] SQL confs don't propagate to spark row writer properly#10786

Merged
danny0405 merged 3 commits intoapache:masterfrom
jonvex:propogate_sqlconf_row_writer_bulk_insert
Mar 5, 2024
Merged

[HUDI-7479] SQL confs don't propagate to spark row writer properly#10786
danny0405 merged 3 commits intoapache:masterfrom
jonvex:propogate_sqlconf_row_writer_bulk_insert

Conversation

@jonvex
Copy link
Contributor

@jonvex jonvex commented Feb 29, 2024

Change Logs

SQL confs are lost when doing bulk insert row writer with deltastreamer.

Impact

SQL conf settings will correctly be applied when using row writer bulk insert

Risk level (write none, low medium or high below)

low

Documentation Update

N/A

Contributor's checklist

  • Read through contributor's guide
  • Change Logs and Impact were stated clearly
  • Adequate tests were added if applicable
  • CI passed

@github-actions github-actions bot added the size:S PR with lines of changes in (10, 100] label Feb 29, 2024
@jonvex jonvex changed the title inject sql confs [HUDI-7479] SQL confs don't propagate to spark row writer properly Mar 4, 2024
@jonvex jonvex marked this pull request as ready for review March 4, 2024 23:28
@apache apache deleted a comment from hudi-bot Mar 4, 2024
@jonvex jonvex requested a review from danny0405 March 5, 2024 01:49
@jonvex jonvex requested a review from danny0405 March 5, 2024 02:14
@hudi-bot
Copy link
Collaborator

hudi-bot commented Mar 5, 2024

CI report:

Bot commands @hudi-bot supports the following commands:
  • @hudi-bot run azure re-run the last Azure build

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

release-0.15.0 size:S PR with lines of changes in (10, 100]

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants