Kerberos Spnego Authentication Router Issue #5706

b-slim · 2018-04-26T01:36:03Z

Kerberos Spnego Auth Router Issue.

Current state of the Kerberos Auth module is broken if Router routes the query to a Broker on a different physical host.
Why?: During the Spnego Auth negotiation the ticket obtained to access the target service is tight to the hostname of the service in question.
This where for instance the Druid internal Http Client generates the challenge token
io.druid.security.kerberos.DruidKerberosUtil#kerberosChallenge as you can see it is hostname based.
Thus the Broker will not be able to decrypt such token and throw an

org.apache.hadoop.security.authentication.client.AuthenticationException: GSSException: Failure unspecified at GSS-API level (Mechanism level: Checksum failed)

you can see the stack here

Fixing this:

Added a decoration method hook at the io.druid.server.AsyncQueryForwardingServlet#sendProxyRequest
that gives the ~~Escalator~~ Authenticator the chance to attache some Request Headers containing authentication tokens that can be used down the chain by Broker.

For instance for the Kerberos Authentication module will be adding the cookie token generated by the early authentication chain.
This cookie is signed by a shared secret druid.auth.authenticator.kerberos.cookieSignatureSecret and tight the the original client Principal/Hostname thus no escalation of privilege at all.
I don't think Basic Auth module needs such hook since the credentials are not tight to hostnames thus no change needed

More information about discussion can be found here

This change is

Change-Id: I872f9282fb60bfa20524271535980a36a87b9621

b-slim · 2018-04-26T01:36:21Z

related to #5322

jon-wei · 2018-04-26T20:51:47Z

extensions-core/druid-kerberos/src/main/java/io/druid/security/kerberos/KerberosEscalator.java

@@ -59,4 +68,21 @@ public AuthenticationResult createEscalatedAuthenticationResult()
  {
    return new AuthenticationResult(internalClientPrincipal, authorizerName, null);
  }
+
+  @Override
+  public void decorateProxyRequest(


This method should be part of the Authenticator instead of the Escalator.

Suppose a user has Kerberos authentication running alongside another authentication scheme, and they wish to use that other authentication scheme for Druid's internal communications. In that case, the Escalator would be of the other authentication type, and this Kerberos code would not be executed.

I think you could indicate the name of the Authenticator that validated a request (maybe put it in the AuthenticationResult), and in AsyncQueryForwardingServlet, get an injected AuthenticatorMapper and use the Authenticator name to lookup which Authenticator instance should be used to decorate the proxy request.

@jon-wei Thanks good point was not aware of that. Will use that map that has the chain and call decorate on each one of them, that should work i guess.

Change-Id: I7f94b9ff5ecf08e8abf7169b58bc410f33148448

Change-Id: I901543e52f0faf4666bfea6256a7c05593b1ae70

b-slim · 2018-04-27T02:23:46Z

@jon-wei thanks please checkout this new version.

jon-wei · 2018-04-27T19:44:33Z

server/src/main/java/io/druid/server/AsyncQueryForwardingServlet.java

@@ -313,6 +317,13 @@ protected void sendProxyRequest(
    // will log that on the remote node.
    clientRequest.setAttribute(AuthConfig.DRUID_AUTHORIZATION_CHECKED, true);

+    authenticatorMapper.getAuthenticatorChain()


This would potentially "overdecorate" the request if decorateProxyRequest is called for every Authenticator, suppose there are two authentication schemes that need request decoration but have mutually exclusive header fields, or some other conflict of that nature.

I would change AuthenticationResult to store the name of the Authenticator that created the AuthenticationResult, and read that name here to lookup the single Authenticator instance that authenticated the request, only that one should decorate the request

@jon-wei am not sure what you mean by mutually exclusive headers? can you give an example for instance here am using cookies that can be redecorated by appending stuff not sure am getting this point?

I would change AuthenticationResult to store the name of the Authenticator that created the AuthenticationResult, and read that name here to lookup the single Authenticator instance that authenticated the request, only that one should decorate the request

From this i read there is only one AuthenticationResult thus this implies that we only have one single authenticator even if the user has a chain of authenticators? is that correct ?
thanks

i am not sure what you mean by mutually exclusive headers? can you give an example for instance here am using cookies that can be redecorated by appending stuff not sure am getting this point?

With just the Kerberos extension, it's not breaking anything, but across potential authentication implementations to me it's not unimaginable or unlikely that such an incompatibility could exist (maybe the proxy decoration for two different authentication schemes uses the same header field, but in an "overwrite" mode instead of "append").

From this i read there is only one AuthenticationResult thus this implies that we only have one single authenticator even if the user has a chain of authenticators? is that correct ?

Yes, the first authenticator that accepts the request as valid should be the one that's used for forwarded requests (the chain behavior is intended to be "stop at first successful authentication" (we already know who the user is now) and not "must succeed with all authentication schemes deployed in the chain").

That "stop at first successful authentication" behavior is enforced by AuthenticationWrappingFilter which wraps all of the Authenticator filters

Change-Id: I052650de9cd02b4faefdbcdaf2332dd3b2966af5

Change-Id: I074d2933460165feeddb19352eac9bd0f96f42ca

b-slim · 2018-04-30T23:39:04Z

@jon-wei thanks for all the feedback please check this out.

Change-Id: Idb58e308f90db88224a06f3759114872165b24f5

jon-wei · 2018-05-01T18:47:08Z

server/src/main/java/io/druid/server/security/AuthenticationResult.java

@@ -37,6 +37,11 @@
   */
  private final String authorizerName;

+
+  /**
+   * Name of authentiator whom created the results


authentiator -> authenticator

jon-wei · 2018-05-01T18:47:22Z

server/src/main/java/io/druid/server/security/AuthenticationResult.java

@@ -68,4 +75,9 @@ public String getAuthorizerName()
  {
    return context;
  }
+
+  public String getAuthentiatedBy()


getAuthentiatedBy -> getAuthenticatedBy

jon-wei · 2018-05-01T19:28:38Z

...ic-security/src/main/java/io/druid/security/basic/authentication/BasicHTTPAuthenticator.java

@@ -105,7 +105,7 @@ public AuthenticationResult authenticateJDBCContext(Map<String, Object> context)
    }

    if (checkCredentials(user, password.toCharArray())) {
-      return new AuthenticationResult(user, name, null);
+      return new AuthenticationResult(user, name, name, null);


Can you change this to:

return new AuthenticationResult(user, authorizerName, name, null);

It's not an error you introduced in this PR, but using "name" for the authorizerName parameter there is a bug

jon-wei · 2018-05-01T21:25:24Z

server/src/main/java/io/druid/server/AsyncQueryForwardingServlet.java

+            clientRequest,
+            proxyResponse,
+            proxyRequest
+        );


Can you log an error here if the authenticator is not found?

Change-Id: I6801d49a05d5d8324406fc0280286954eb66db10

Change-Id: I390b12af74f44d760d0812a519125fbf0df4e97b

b-slim · 2018-05-02T01:32:58Z

done

jon-wei · 2018-05-02T02:12:26Z

Great, LGTM after CI

nishantmonu51 · 2018-05-02T19:19:32Z

extensions-core/druid-kerberos/src/main/java/io/druid/security/kerberos/KerberosEscalator.java

@@ -57,6 +57,7 @@ public HttpClient createEscalatedClient(HttpClient baseClient)
  @Override
  public AuthenticationResult createEscalatedAuthenticationResult()
  {
-    return new AuthenticationResult(internalClientPrincipal, authorizerName, null);
+    return new AuthenticationResult(internalClientPrincipal, authorizerName, "kerberos", null);


user may not have authenticator configured by name "kerberos",
this should not be hardcoded
e.g for configs -
druid.auth.authenticatorChain=["MyKerberosAuthenticator"]
druid.auth.authenticator.MyKerberosAuthenticator.type=kerberos

this should be set to MyKerberosAuthenticator I think.

nishantmonu51 · 2018-05-02T19:20:24Z

...-basic-security/src/main/java/io/druid/security/basic/authentication/BasicHTTPEscalator.java

@@ -59,6 +59,6 @@ public HttpClient createEscalatedClient(HttpClient baseClient)
  @Override
  public AuthenticationResult createEscalatedAuthenticationResult()
  {
-    return new AuthenticationResult(internalClientUsername, authorizerName, null);
+    return new AuthenticationResult(internalClientUsername, authorizerName, "basic", null);


do not hard code "basic" here ?

nishantmonu51 · 2018-05-02T19:22:34Z

...ions-core/druid-kerberos/src/main/java/io/druid/security/kerberos/KerberosAuthenticator.java

@@ -113,6 +122,7 @@ public KerberosAuthenticator(
      @JsonProperty("excludedPaths") List<String> excludedPaths,
      @JsonProperty("cookieSignatureSecret") String cookieSignatureSecret,
      @JsonProperty("authorizerName") String authorizerName,
+      @JsonProperty("name") String name,


new property - please add to docs.

this is injected by the Jackson from the list of authenticators. user does not set this

sounds good.

nishantmonu51 · 2018-05-02T19:26:48Z

server/src/main/java/io/druid/server/AsyncQueryForwardingServlet.java

+    if (authenticationResult != null && authenticationResult.getAuthenticatedBy() != null) {
+      Authenticator authenticator = authenticatorMapper.getAuthenticatorMap()
+                                                       .get(authenticationResult.getAuthenticatedBy());
+      if (authenticator != null) {


If I am not wrong user needs to make sure that he defines a property like this for every authenticator -
druid.auth.authenticator..name=
If it possible to infer the name without making the user add this property ?
If not lets make sure we document this.

it is coming from the list of authenticators and injected at the Authenticator module.

sounds good.

Change-Id: I62c3ee763363781e52809ec912aafd50b8486b8e

jon-wei · 2018-05-03T21:26:16Z

...-basic-security/src/main/java/io/druid/security/basic/authentication/BasicHTTPEscalator.java

@@ -59,6 +60,6 @@ public HttpClient createEscalatedClient(HttpClient baseClient)
  @Override
  public AuthenticationResult createEscalatedAuthenticationResult()
  {
-    return new AuthenticationResult(internalClientUsername, authorizerName, "basic", null);
+    return new AuthenticationResult(internalClientUsername, authorizerName, BASIC, null);


The "Escalator" is really conceptually linked to one of the "Authenticator" implementations (the authentication used for internal communications has to be something that a configured Authenticator would accept), the interface was split for reasons described here (#5073)

I guess the way I would handle this now is to add something like a new "druid.escalator.authenticatorName" property that Escalator implementations can use to fill this AuthenticationResult property.

This createEscalatedAuthenticationResult() method is only used on the Broker for some internal SQL code paths (when the broker itself runs a segment metadata query and when it needs to use the SQL planner for a currently unfinished "views" feature, see DruidViewMacro), to allow it to reuse existing code paths without larger refactoring or introducing a special "skip authorization checks because I am the broker myself" code path. This value doesn't really matter in practice here, and maybe it'd be nice to get rid of the method altogether eventually, so I hadn't commented on it initially.

@jon-wei am not sure about adding a new property i don't think it the way to go it adds more confusion then benefits IMO. If i am getting this right there is one to one mapping between escalator type and authenticator name/type. Thus if the user selects/sets the property druid.escalator.type it should be enough and the implementation of escalator with type X will set the appropriate name for the authenticator entity. How does this sound?

If i am getting this right there is one to one mapping between escalator type and authenticator name/type.

Authenticator name/type are not necessarily correlated (I can name my kerberos authenticator "George" if I wanted).

There's also no restriction on having two Authenticators of the same type (maybe that makes sense for some hypothetical implementation where running two instances with a different "namespace" or similar concept makes sense).

So there is only a mapping between a specific escalator instance and an authenticator instance, which is why I suggest adding the property.

hum, i really feel like druid has way too much properties and i feel bad when i add another one to the zillion of properties...let me think more about this

@jon-wei since that escalated result is used only by druid and it is not suppose to be involved into the query path coming from a user will set that to null i don't see why we need to decorate the proxied query using that result. What you think?

I'm okay with having that null for this PR, can you add a comment explaining it (maybe link it to this comment thread)

Escalator. Change-Id: I4a675c372f59ebd8a8d19c61b85a1e4bf227a8ba

b-slim · 2018-05-04T14:10:12Z

@jon-wei and @nishantmonu51 can you please take a QL on this.

nishantmonu51

LGTM, 👍

nishantmonu51 · 2018-05-04T19:47:18Z

server/src/main/java/io/druid/server/security/AuthenticationResult.java

@@ -37,6 +37,15 @@
   */
  private final String authorizerName;

+
+  /**
+   * Name of authenticator whom created the results


nit: s/whom/that/g

gianm · 2018-05-08T17:39:47Z

As discussed on the dev sync let's do this in 0.12.1 if it backports cleanly.

* Adding decoration method to proxy servlet Change-Id: I872f9282fb60bfa20524271535980a36a87b9621 * moving the proxy request decoration to authenticators Change-Id: I7f94b9ff5ecf08e8abf7169b58bc410f33148448 * added docs Change-Id: I901543e52f0faf4666bfea6256a7c05593b1ae70 * use the authentication result to decorate request Change-Id: I052650de9cd02b4faefdbcdaf2332dd3b2966af5 * adding authenticated by name Change-Id: I074d2933460165feeddb19352eac9bd0f96f42ca * ensure that authenticator is not null Change-Id: Idb58e308f90db88224a06f3759114872165b24f5 * fix types and minor bug Change-Id: I6801d49a05d5d8324406fc0280286954eb66db10 * fix typo Change-Id: I390b12af74f44d760d0812a519125fbf0df4e97b * use actual type names Change-Id: I62c3ee763363781e52809ec912aafd50b8486b8e * set authenitcatedBy to null for AutheticationResults created by Escalator. Change-Id: I4a675c372f59ebd8a8d19c61b85a1e4bf227a8ba

Adding decoration method to proxy servlet

769faf4

Change-Id: I872f9282fb60bfa20524271535980a36a87b9621

jon-wei reviewed Apr 26, 2018

View reviewed changes

b-slim added 2 commits April 26, 2018 18:52

moving the proxy request decoration to authenticators

73ffd71

Change-Id: I7f94b9ff5ecf08e8abf7169b58bc410f33148448

added docs

97cab90

Change-Id: I901543e52f0faf4666bfea6256a7c05593b1ae70

jon-wei reviewed Apr 27, 2018

View reviewed changes

b-slim added 2 commits April 29, 2018 17:30

use the authentication result to decorate request

907bdcf

Change-Id: I052650de9cd02b4faefdbcdaf2332dd3b2966af5

adding authenticated by name

65698fe

Change-Id: I074d2933460165feeddb19352eac9bd0f96f42ca

b-slim added 2 commits April 30, 2018 17:40

Merge branch 'master' into fix_ker_router_upstream

0dfd198

ensure that authenticator is not null

2d0b3ca

Change-Id: Idb58e308f90db88224a06f3759114872165b24f5

jon-wei reviewed May 1, 2018

View reviewed changes

b-slim added 2 commits May 1, 2018 17:27

fix types and minor bug

922e26d

Change-Id: I6801d49a05d5d8324406fc0280286954eb66db10

fix typo

5366244

Change-Id: I390b12af74f44d760d0812a519125fbf0df4e97b

nishantmonu51 reviewed May 2, 2018

View reviewed changes

use actual type names

ac74b8e

Change-Id: I62c3ee763363781e52809ec912aafd50b8486b8e

jon-wei reviewed May 3, 2018

View reviewed changes

b-slim added Bug Area - Router labels May 3, 2018

b-slim added this to the 0.13.0 milestone May 3, 2018

set authenitcatedBy to null for AutheticationResults created by

0c8503f

Escalator. Change-Id: I4a675c372f59ebd8a8d19c61b85a1e4bf227a8ba

nishantmonu51 approved these changes May 4, 2018

View reviewed changes

jon-wei approved these changes May 4, 2018

View reviewed changes

b-slim merged commit 8aa8d9f into apache:master May 6, 2018

gianm modified the milestones: 0.13.0, 0.12.1 May 8, 2018

b-slim mentioned this pull request May 8, 2018

[Backport] Kerberos Spnego Authentication Router Issue #5757

Merged

jihoonson mentioned this pull request May 15, 2018

Druid 0.12.1 release notes #5743

Closed

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Kerberos Spnego Authentication Router Issue #5706

Kerberos Spnego Authentication Router Issue #5706

b-slim commented Apr 26, 2018 •

edited

b-slim commented Apr 26, 2018

jon-wei Apr 26, 2018 •

edited

b-slim Apr 27, 2018

b-slim commented Apr 27, 2018

jon-wei Apr 27, 2018

b-slim Apr 27, 2018

jon-wei Apr 27, 2018

jon-wei Apr 27, 2018

b-slim commented Apr 30, 2018

jon-wei May 1, 2018

jon-wei May 1, 2018

jon-wei May 1, 2018

jon-wei May 1, 2018

b-slim commented May 2, 2018

jon-wei commented May 2, 2018

nishantmonu51 May 2, 2018

nishantmonu51 May 2, 2018

nishantmonu51 May 2, 2018

b-slim May 2, 2018

nishantmonu51 May 2, 2018

nishantmonu51 May 2, 2018

b-slim May 2, 2018

nishantmonu51 May 2, 2018

jon-wei May 3, 2018 •

edited

b-slim May 3, 2018

jon-wei May 3, 2018

b-slim May 3, 2018

b-slim May 3, 2018

jon-wei May 4, 2018

b-slim commented May 4, 2018

nishantmonu51 left a comment

nishantmonu51 May 4, 2018

gianm commented May 8, 2018

Kerberos Spnego Authentication Router Issue #5706

Kerberos Spnego Authentication Router Issue #5706

Conversation

b-slim commented Apr 26, 2018 • edited

Kerberos Spnego Auth Router Issue.

Fixing this:

b-slim commented Apr 26, 2018

jon-wei Apr 26, 2018 • edited

Choose a reason for hiding this comment

Choose a reason for hiding this comment

b-slim commented Apr 27, 2018

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

b-slim commented Apr 30, 2018

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

b-slim commented May 2, 2018

jon-wei commented May 2, 2018

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

jon-wei May 3, 2018 • edited

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

b-slim commented May 4, 2018

nishantmonu51 left a comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

gianm commented May 8, 2018

b-slim commented Apr 26, 2018 •

edited

jon-wei Apr 26, 2018 •

edited

jon-wei May 3, 2018 •

edited