Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[SPARK-42345][SQL] Rename TimestampNTZ inference conf as spark.sql.sources.timestampNTZTypeInference.enabled #39885

Closed
wants to merge 2 commits into from

Conversation

gengliangwang
Copy link
Member

What changes were proposed in this pull request?

Rename TimestampNTZ data source inference configuration from spark.sql.inferTimestampNTZInDataSources.enabled to spark.sql.sources.timestampNTZTypeInference.enabled
For more context on this configuration:
#39777
#39812
#39868

Why are the changes needed?

Since the configuration is for data source, we can put it under the prefix spark.sql.sources. The new naming is consistent with another configuration spark.sql.sources.partitionColumnTypeInference.enabled.

Does this PR introduce any user-facing change?

How was this patch tested?

Copy link
Member

@MaxGekk MaxGekk left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This comment should be changes too:

// "spark.sql.inferTimestampNTZInDataSources.enabled".

@gengliangwang
Copy link
Member Author

@MaxGekk Thanks. I have updated the comment.

Copy link
Member

@dongjoon-hyun dongjoon-hyun left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

+1, LGTM.

@MaxGekk
Copy link
Member

MaxGekk commented Feb 5, 2023

+1, LGTM. Merging to master/3.4.
Thank you, @gengliangwang and @dongjoon-hyun @HyukjinKwon for review.

@MaxGekk MaxGekk closed this in c5c1927 Feb 5, 2023
MaxGekk pushed a commit that referenced this pull request Feb 5, 2023
…urces.timestampNTZTypeInference.enabled

### What changes were proposed in this pull request?

Rename TimestampNTZ data source inference configuration from `spark.sql.inferTimestampNTZInDataSources.enabled` to `spark.sql.sources.timestampNTZTypeInference.enabled`
For more context on this configuration:
#39777
#39812
#39868
### Why are the changes needed?

Since the configuration is for data source, we can put it under the prefix `spark.sql.sources`. The new naming is consistent with another configuration `spark.sql.sources.partitionColumnTypeInference.enabled`.

### Does this PR introduce _any_ user-facing change?

### How was this patch tested?

Closes #39885 from gengliangwang/renameConf.

Authored-by: Gengliang Wang <gengliang@apache.org>
Signed-off-by: Max Gekk <max.gekk@gmail.com>
(cherry picked from commit c5c1927)
Signed-off-by: Max Gekk <max.gekk@gmail.com>
snmvaughan pushed a commit to snmvaughan/spark that referenced this pull request Jun 20, 2023
…urces.timestampNTZTypeInference.enabled

### What changes were proposed in this pull request?

Rename TimestampNTZ data source inference configuration from `spark.sql.inferTimestampNTZInDataSources.enabled` to `spark.sql.sources.timestampNTZTypeInference.enabled`
For more context on this configuration:
apache#39777
apache#39812
apache#39868
### Why are the changes needed?

Since the configuration is for data source, we can put it under the prefix `spark.sql.sources`. The new naming is consistent with another configuration `spark.sql.sources.partitionColumnTypeInference.enabled`.

### Does this PR introduce _any_ user-facing change?

### How was this patch tested?

Closes apache#39885 from gengliangwang/renameConf.

Authored-by: Gengliang Wang <gengliang@apache.org>
Signed-off-by: Max Gekk <max.gekk@gmail.com>
(cherry picked from commit c5c1927)
Signed-off-by: Max Gekk <max.gekk@gmail.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
4 participants