Skip to content

Comments

[SPARK-44203][SQL][HIVE] Return nextRenewalDate instead of None for obtainDelegationTokens method#41983

Closed
jiaoqingbo wants to merge 1 commit intoapache:masterfrom
jiaoqingbo:SPARK-44203
Closed

[SPARK-44203][SQL][HIVE] Return nextRenewalDate instead of None for obtainDelegationTokens method#41983
jiaoqingbo wants to merge 1 commit intoapache:masterfrom
jiaoqingbo:SPARK-44203

Conversation

@jiaoqingbo
Copy link
Contributor

@jiaoqingbo jiaoqingbo commented Jul 13, 2023

What changes were proposed in this pull request?

Return nextRenewalDate instead of None for obtainDelegationTokens method

Why are the changes needed?

Regarding hive token, there are some configuration parameters as follows

metastore.cluster.delegation.key.update-interval / hive.cluster.delegation.key.update-interval
metastore.cluster.delegation.token.gc-interval / hive.cluster.delegation.token.gc-interval
metastore.cluster.delegation.token.max-lifetime / hive.cluster.delegation.token.max-lifetime
metastore.cluster.delegation.token.renew-interval / hive.cluster.delegation.token.renew-interval
metastore.cluster.delegation.token.store.class / hive.cluster.delegation.token.store.class

Return nextRenewalDate instead of None for obtainDelegationTokens method

Does this PR introduce any user-facing change?

NO

How was this patch tested?

manual test

23/07/13 14:17:04 DEBUG HiveDelegationTokenProvider: Get Token from hive metastore: Kind: HIVE_DELEGATION_TOKEN, Service: , Ident: 00 13 6f 63 64 70 2d 64 70 31 38 34 40 4f 43 44 50 2e 43 4f 4d 04 6f 63 64 70 13 6f 63 64 70 2d 64 70 31 38 34 40 4f 43 44 50 2e 43 4f 4d 8a 01 89 4d e5 5c 71 8a 01 89 71 f1 e0 71 8e 01 2a 3c
23/07/13 14:17:04 DEBUG HiveDelegationTokenProvider: Got Delegation token is HIVE_DELEGATION_TOKEN owner=xxx@xxxx, renewer=xxx, realUser=xxx@xxxx, issueDate=1689229024369, maxDate=1689833824369, sequenceNumber=298, masterKeyId=60
23/07/13 14:17:04 DEBUG TSaslTransport: writing data length: 188
23/07/13 14:17:04 DEBUG TSaslTransport: CLIENT: reading data length: 46
23/07/13 14:17:04 INFO HiveDelegationTokenProvider: Renewal interval is 86400179 for token HIVE_DELEGATION_TOKEN
23/07/13 14:17:04 DEBUG HiveDelegationTokenProvider: Renewal date is 1689315424548 for token HIVE_DELEGATION_TOKEN

@jiaoqingbo
Copy link
Contributor Author

jiaoqingbo commented Jul 21, 2023

cc @ulysses-you @HyukjinKwon

@github-actions
Copy link

We're closing this PR because it hasn't been updated in a while. This isn't a judgement on the merit of the PR in any way. It's just a way of keeping the PR queue manageable.
If you'd like to revive this PR, please reopen it and ask a committer to remove the Stale tag!

@github-actions github-actions bot added the Stale label Nov 13, 2023
@github-actions github-actions bot closed this Nov 14, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant