-
Notifications
You must be signed in to change notification settings - Fork 28.2k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[SPARK-26592][SS] Throw exception when kafka delegation token tried to obtain with proxy user #23511
Conversation
…o obtain with proxy user.
Test build #101033 has finished for PR 23511 at commit
|
retest this please |
Test build #101042 has finished for PR 23511 at commit
|
core/src/test/scala/org/apache/spark/deploy/security/KafkaTokenUtilSuite.scala
Show resolved
Hide resolved
Hi, @gaborgsomogyi . Mostly, looks correct. Only one minor comment. |
@dongjoon-hyun thanks for the review, addressed. |
Test build #101078 has finished for PR 23511 at commit
|
retest this please |
core/src/test/scala/org/apache/spark/deploy/security/KafkaTokenUtilSuite.scala
Outdated
Show resolved
Hide resolved
Test build #101088 has finished for PR 23511 at commit
|
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
LGTM except @vanzin commented.
Test build #101141 has finished for PR 23511 at commit
|
Test build #101143 has finished for PR 23511 at commit
|
@@ -78,6 +80,21 @@ class KafkaTokenUtilSuite extends SparkFunSuite with BeforeAndAfterEach { | |||
Configuration.setConfiguration(null) | |||
} | |||
|
|||
test("checkProxyUser with proxy current user should throw exception") { | |||
val realUser = UserGroupInformation.createUserForTesting("realUser", Array()) |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
not a big deal but Array()
-> Array.empty[String]
. Ignore this if everything in this PR is ready
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
LGTM
Merging to master. |
…o obtain with proxy user ## What changes were proposed in this pull request? Kafka is not yet support to obtain delegation token with proxy user. It has to be turned off until https://issues.apache.org/jira/browse/KAFKA-6945 implemented. In this PR an exception will be thrown when this situation happens. ## How was this patch tested? Additional unit test. Closes apache#23511 from gaborgsomogyi/SPARK-26592. Authored-by: Gabor Somogyi <gabor.g.somogyi@gmail.com> Signed-off-by: Marcelo Vanzin <vanzin@cloudera.com>
What changes were proposed in this pull request?
Kafka is not yet support to obtain delegation token with proxy user. It has to be turned off until https://issues.apache.org/jira/browse/KAFKA-6945 implemented.
In this PR an exception will be thrown when this situation happens.
How was this patch tested?
Additional unit test.