Skip to content

[MINOR] Do not force setting spark conf in UtilHelpers#11166

Merged
danny0405 merged 2 commits intoapache:masterfrom
Zouxxyy:dev/remove-port
May 7, 2024
Merged

[MINOR] Do not force setting spark conf in UtilHelpers#11166
danny0405 merged 2 commits intoapache:masterfrom
Zouxxyy:dev/remove-port

Conversation

@Zouxxyy
Copy link
Contributor

@Zouxxyy Zouxxyy commented May 7, 2024

Change Logs

In UtilHelpers's buildSparkConf, it force setting some spark configs, which cause the custom configs cannot be used like spark.ui.port

Impact

Do not force setting spark configs in UtilHelpers

Risk level (write none, low medium or high below)

low

Documentation Update

None

Contributor's checklist

  • Read through contributor's guide
  • Change Logs and Impact were stated clearly
  • Adequate tests were added if applicable
  • CI passed

@Zouxxyy Zouxxyy closed this May 7, 2024
1
This reverts commit a1761ff.
@Zouxxyy Zouxxyy reopened this May 7, 2024
@Zouxxyy Zouxxyy changed the title [MINOR] Do not force setting spark ui port in UtilHelpers [MINOR] Do not force setting spark conf in UtilHelpers May 7, 2024
@github-actions github-actions bot added the size:S PR with lines of changes in (10, 100] label May 7, 2024
@hudi-bot
Copy link
Collaborator

hudi-bot commented May 7, 2024

CI report:

Bot commands @hudi-bot supports the following commands:
  • @hudi-bot run azure re-run the last Azure build

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

size:S PR with lines of changes in (10, 100]

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants