New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
ZEPPELIN-1199. Need to login using keytab and principal before creating SparkContext in secured cluster #1206
Conversation
Might need to check whether it works in pyspark/sparkr. |
pyspark and sprakr both create SparkContext, so this fix also works in pyspark & sparkr |
@@ -337,6 +339,15 @@ public SparkContext createSparkContext() { | |||
conf.set("spark.yarn.isPython", "true"); | |||
} | |||
|
|||
if (conf.contains("spark.yarn.keytab") && conf.contains("spark.yarn.principal")) { | |||
try { | |||
String keytab = conf.get("spark.yarn.keytab"); |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Why are we logging on with spark keytab instead of zeppelin keytab?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
This is not zeppelin keytab. It is just keytab specified by zeppelin. Every interpreter has its own setting, and this is just one of the setting.
@zjffdu can you resolve conflict ? |
…ng SparkContext in secured cluster
@prabhjyotsingh Conflicts resolved. |
LGTM |
Close it and merge it to #1237 |
What is this PR for?
Need to login using keytab and principal before creating SparkContext in secured cluster.
What type of PR is it?
[Bug Fix]
What is the Jira issue?
How should this be tested?
Manually verified in a secured cluster.
Screenshots (if appropriate)
Questions: