New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
HADOOP-16640. WASB: Override getCanonicalServiceName() to return URI #1621
Conversation
… url of WASB filesystem
+1 |
🎊 +1 overall
This message was automatically generated. |
WASB tests passed: |
If you return a non-null value from this method, you are telling callers that you will will be issuing a delegation token, that is getDelegationToken() is non-null Is that your intent? if so then you don't need an extra option for it -just ask whatever issues DTs for the FS if it has a DT or is willing to issue one. |
@steveloughran Here is the issue reported by wasb customer: BTW, from the documentation, this API should only be used by token cache but not others, so it seem HBase should not rely on this call to do the check? |
@steveloughran does it look good to you? |
}); | ||
|
||
// clear fs cache | ||
FileSystem.closeAll(); |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
you don't need to do that , just call FileSystem.newInstance(defaultURI, conf)
, remembering to close the new FS afterwards
small change to the tests proposed, but LGTM. I do worry that a lot of the abfs config is hidden in the javadocs. Someone should fix that with more user docs. I know its not that relevant for managed cluster deployments (HD/I etc), but for people talking to abfs externally, it really matters. |
2c9b556
to
3cd0418
Compare
Sure, I've added HADOOP-16659 for work on adding the missing docs for the abfs/wasb config. |
🎊 +1 overall
This message was automatically generated. |
🎊 +1 overall
This message was automatically generated. |
committed, closing it. |
Add a configuration to override getCanonicalServiceName() to return URI of WASB FS.