Skip to content

[VL] Support pass unmapped dynamic and static configs to Velox #11229

Merged
Yohahaha merged 2 commits intoapache:mainfrom
Yohahaha:pass-velox-conf
Dec 3, 2025
Merged

[VL] Support pass unmapped dynamic and static configs to Velox #11229
Yohahaha merged 2 commits intoapache:mainfrom
Yohahaha:pass-velox-conf

Conversation

@Yohahaha
Copy link
Copy Markdown
Contributor

@Yohahaha Yohahaha commented Dec 1, 2025

What changes are proposed in this pull request?

Avoid re-compile and publish whole project when we need overwrite some configs in prod env.

How was this patch tested?

@github-actions github-actions Bot added the VELOX label Dec 1, 2025
@Yohahaha
Copy link
Copy Markdown
Contributor Author

Yohahaha commented Dec 2, 2025

@Zouxxyy @liujiayi771

configs[facebook::velox::connector::hive::HiveConfig::kOrcUseColumnNamesSession] =
conf->get<bool>(kOrcUseColumnNames, true) ? "true" : "false";

overwriteVeloxConf(conf.get(), configs, kDynamicBackendConfPrefix);
Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Would this introduce some redundant config set?

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

only works for unmapped configs, mapped configs use spark defined name.

@Yohahaha Yohahaha merged commit fc8d37e into apache:main Dec 3, 2025
195 of 199 checks passed
@Yohahaha Yohahaha deleted the pass-velox-conf branch December 3, 2025 03:12
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants