Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[SPARK-9228] [SQL] use tungsten.enabled in public for both of codegen/unsafe #7998

Closed
wants to merge 2 commits into from

Conversation

davies
Copy link
Contributor

@davies davies commented Aug 6, 2015

spark.sql.tungsten.enabled will be the default value for both codegen and unsafe, they are kept internally for debug/testing.

cc @marmbrus @rxin

@@ -223,14 +223,21 @@ private[spark] object SQLConf {
defaultValue = Some(200),
doc = "The default number of partitions to use when shuffling data for joins or aggregations.")

val CODEGEN_ENABLED = booleanConf("spark.sql.codegen",
val TUNGSTEN_ENABLED = booleanConf("spark.sql.tungsten.enabled",
Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Should we use a better name for this? tungsten will not be easy for user to understand.

@SparkQA
Copy link

SparkQA commented Aug 6, 2015

Test build #40055 has finished for PR 7998 at commit c1c16da.

  • This patch fails to build.
  • This patch merges cleanly.
  • This patch adds the following public classes (experimental):
    • case class StringTranslate(srcExpr: Expression, matchingExpr: Expression, replaceExpr: Expression)

asfgit pushed a commit that referenced this pull request Aug 7, 2015
…/unsafe

spark.sql.tungsten.enabled will be the default value for both codegen and unsafe, they are kept internally for debug/testing.

cc marmbrus rxin

Author: Davies Liu <davies@databricks.com>

Closes #7998 from davies/tungsten and squashes the following commits:

c1c16da [Davies Liu] update doc
1a47be1 [Davies Liu] use tungsten.enabled for both of codegen/unsafe

(cherry picked from commit 4e70e82)
Signed-off-by: Davies Liu <davies.liu@gmail.com>
@asfgit asfgit closed this in 4e70e82 Aug 7, 2015
@SparkQA
Copy link

SparkQA commented Aug 7, 2015

Test build #1393 has finished for PR 7998 at commit c1c16da.

  • This patch passes all tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

@rxin
Copy link
Contributor

rxin commented Aug 7, 2015

I've merged this again.

asfgit pushed a commit that referenced this pull request Aug 7, 2015
…/unsafe

spark.sql.tungsten.enabled will be the default value for both codegen and unsafe, they are kept internally for debug/testing.

cc marmbrus rxin

Author: Davies Liu <davies@databricks.com>

Closes #7998 from davies/tungsten and squashes the following commits:

c1c16da [Davies Liu] update doc
1a47be1 [Davies Liu] use tungsten.enabled for both of codegen/unsafe

(cherry picked from commit 4e70e82)
Signed-off-by: Reynold Xin <rxin@databricks.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
3 participants