Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[SPARK-31550][SQL][DOCS] Set nondeterministic configurations with general meanings in sql configuration doc #28322

Closed
wants to merge 4 commits into from

Conversation

yaooqinn
Copy link
Member

@yaooqinn yaooqinn commented Apr 24, 2020

What changes were proposed in this pull request?

spark.sql.session.timeZone

spark.sql.warehouse.dir

these 2 configs are nondeterministic and vary with environments

Besides, reflect code in gen-sql-config-docs.py via #28274 (comment) and configuration.md via #28274 (comment)

Why are the changes needed?

doc fix

Does this PR introduce any user-facing change?

no

How was this patch tested?

verify locally
image

@SparkQA
Copy link

SparkQA commented Apr 24, 2020

Test build #121721 has finished for PR 28322 at commit 42009fd.

  • This patch fails due to an unknown error code, -9.
  • This patch merges cleanly.
  • This patch adds no public classes.

@yaooqinn
Copy link
Member Author

Jenkins, retest this please

@SparkQA
Copy link

SparkQA commented Apr 24, 2020

Test build #121729 has finished for PR 28322 at commit 42009fd.

  • This patch fails PySpark unit tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

@HyukjinKwon
Copy link
Member

retest this please

@SparkQA
Copy link

SparkQA commented Apr 24, 2020

Test build #121750 has finished for PR 28322 at commit 42009fd.

  • This patch passes all tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

@yaooqinn
Copy link
Member Author

cc: @dongjoon-hyun @cloud-fan @maropu too, thanks.

@SparkQA
Copy link

SparkQA commented Apr 25, 2020

Test build #121800 has finished for PR 28322 at commit d47687f.

  • This patch passes all tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

@SparkQA
Copy link

SparkQA commented Apr 26, 2020

Test build #121830 has finished for PR 28322 at commit 3d985a4.

  • This patch fails Python style tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

@SparkQA
Copy link

SparkQA commented Apr 26, 2020

Test build #121843 has finished for PR 28322 at commit a2e7e51.

  • This patch passes all tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

@HyukjinKwon
Copy link
Member

Merged to master and branch-3.0.

HyukjinKwon pushed a commit that referenced this pull request Apr 27, 2020
…eral meanings in sql configuration doc

### What changes were proposed in this pull request?

```scala
spark.sql.session.timeZone

spark.sql.warehouse.dir
```
these 2 configs are nondeterministic and vary with environments

Besides, reflect code in `gen-sql-config-docs.py` via  #28274 (comment) and `configuration.md` via #28274 (comment)
### Why are the changes needed?

doc fix

### Does this PR introduce any user-facing change?

no
### How was this patch tested?

verify locally
![image](https://user-images.githubusercontent.com/8326978/80179099-5e7da200-8632-11ea-803f-d47a93151869.png)

Closes #28322 from yaooqinn/SPARK-31550.

Authored-by: Kent Yao <yaooqinn@hotmail.com>
Signed-off-by: HyukjinKwon <gurwls223@apache.org>
(cherry picked from commit 5ba467c)
Signed-off-by: HyukjinKwon <gurwls223@apache.org>
@maropu
Copy link
Member

maropu commented Apr 27, 2020

late LGTM, thanks for the update, @yaooqinn

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
4 participants