-
Notifications
You must be signed in to change notification settings - Fork 28.1k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[SPARK-8650][SQL] Use the user-specified app name priority in SparkSQLCLIDriver or HiveThriftServer2 #7030
Conversation
test this please. |
Can we query the app name in cli or beeline? If so, I am wondering if we can have a test for this change. |
Test build #35902 has finished for PR 7030 at commit
|
@@ -38,9 +38,11 @@ private[hive] object SparkSQLEnv extends Logging { | |||
val sparkConf = new SparkConf(loadDefaults = true) | |||
val maybeSerializer = sparkConf.getOption("spark.serializer") | |||
val maybeKryoReferenceTracking = sparkConf.getOption("spark.kryo.referenceTracking") | |||
val maybeAppName = sparkConf.getOption("spark.app.name") | |||
.filter(!_.equals("org.apache.spark.sql.hive.thriftserver.SparkSQLCLIDriver")) |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Can you add a comment to explain this filter
?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Minor styling suggestion:
val maybeAppName = sparkConf
.getOption("spark.app.name")
.filterNot(_ == classOf[SparkSQLCLIDriver].getName)
LGTM |
ok to test |
Test build #36088 has finished for PR 7030 at commit
|
Thanks! Merging to master. |
When run
![before](https://cloud.githubusercontent.com/assets/1400819/8370336/fa20b75a-1bf8-11e5-9171-040049a53240.png)
./bin/spark-sql --name query1.sql
[Before]
[After]
![after](https://cloud.githubusercontent.com/assets/1400819/8370189/dcc35cb4-1bf6-11e5-8796-a0694140bffb.png)