Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[SPARK-12926][SQL] SQLContext to display warning message when non-sql configs are being set #10849

Closed
wants to merge 3 commits into from
Closed

[SPARK-12926][SQL] SQLContext to display warning message when non-sql configs are being set #10849

wants to merge 3 commits into from

Commits on Jan 20, 2016

  1. [SPARK-12926][SQL] SQLContext to disallow users passing non-sql configs

    @tejasapatil
    tejasapatil committed Jan 20, 2016
    Configuration menu
    Copy the full SHA
    0741c5d View commit details
    Browse the repository at this point in the history

Commits on Jan 21, 2016

  1. Changed from exception to WARN statement. 

    Testing:

```
scala> sqlContext.sql("SET spark.shuffle.memoryFraction=0.4")
16/01/21 08:26:47 WARN SQLConf: Attempt to set non-Spark SQL config in SQLConf: key = spark.shuffle.memoryFraction, value = 0.4
res2: org.apache.spark.sql.DataFrame = [key: string, value: string]

scala> sqlContext.getConf("spark.shuffle.memoryFraction")
res3: String = 0.4
```
    @tejasapatil
    tejasapatil committed Jan 21, 2016
    Configuration menu
    Copy the full SHA
    7f1e317 View commit details
    Browse the repository at this point in the history

Commits on Jan 26, 2016

  1. Fixed scala checkstyle. Verified by running: `sbt sql/compile:scalast… 

    …yle`
    @tejasapatil
    tejasapatil committed Jan 26, 2016
    Configuration menu
    Copy the full SHA
    f982d54 View commit details
    Browse the repository at this point in the history