Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Mount two same name ns to alluxio can not be support #9000

Closed
maobaolong opened this issue May 7, 2019 · 5 comments
Closed

Mount two same name ns to alluxio can not be support #9000

maobaolong opened this issue May 7, 2019 · 5 comments
Labels
type-bug This issue is about a bug

Comments

@maobaolong
Copy link
Contributor

maobaolong commented May 7, 2019

Alluxio Version:
Alluxio-2.0.0-SNAPSHOT, in fact, i build it from master branch at 5/5/2019

Describe the bug

Blank in my mount commandline will be parsed as a parameter

To Reproduce

  • /software/servers/alluxio-2.0.0-preview/bin/alluxio mkdir /tmp

  • /software/servers/alluxio-2.0.0-preview/bin/alluxio fs mount --readonly --option alluxio.underfs.hdfs.configuration=/software/servers/alluxio-2.0.0-preview/hadoop-conf/cluster1/hadoop/hdfs-site.xml /tmp/app-logs/ hdfs://ns19/tmp/app-logs/

  • /software/servers/alluxio-2.0.0-preview/bin/alluxio fs mount --readonly --option alluxio.underfs.hdfs.configuration=/software/servers/alluxio-2.0.0-preview/hadoop-conf/cluster2/hadoop/hdfs-site.xml /tmp/app-logs2/ hdfs://ns19/tmp/app-logs/

Expected behavior

Mount point hdfs://ns19/tmp/app-logs is a prefix of hdfs://ns19/tmp/app-logs

Urgency

urgent

Additional context

if we can support this, we can combine our all hdfs cluster's ns.

@maobaolong maobaolong added the type-bug This issue is about a bug label May 7, 2019
@yuzhu yuzhu closed this as completed Oct 25, 2021
@maobaolong
Copy link
Contributor Author

Hi @yuzhu , is this issue has been fixed? If so, I'd like to have a try.

@yuzhu
Copy link
Contributor

yuzhu commented Oct 27, 2021

could you describe the issue in a different way maybe? I was not too sure what you meant there. looks like you were trying to mount the same hdfs path twice?

@yuzhu yuzhu reopened this Oct 27, 2021
@maobaolong
Copy link
Contributor Author

@yuzhu Sorry for the confusing description, let me show more detail.

The ns19 in /software/servers/alluxio-2.0.0-preview/hadoop-conf/cluster1/hadoop/hdfs-site.xml means to connect namenode address A, and ns19 in /software/servers/alluxio-2.0.0-preview/hadoop-conf/cluster2/hadoop/hdfs-site.xml stand for namenode address B.

So the following two mount behaviors is different. we should check whether the two ns19 are same.

/software/servers/alluxio-2.0.0-preview/bin/alluxio fs mount --readonly --option alluxio.underfs.hdfs.configuration=/software/servers/alluxio-2.0.0-preview/hadoop-conf/cluster1/hadoop/hdfs-site.xml /tmp/app-logs/ hdfs://ns19/tmp/app-logs/
/software/servers/alluxio-2.0.0-preview/bin/alluxio fs mount --readonly --option alluxio.underfs.hdfs.configuration=/software/servers/alluxio-2.0.0-preview/hadoop-conf/cluster2/hadoop/hdfs-site.xml /tmp/app-logs2/ hdfs://ns19/tmp/app-logs/

@LuQQiu
Copy link
Contributor

LuQQiu commented Jan 9, 2023

@maobaolong is this being addressed? why is it hard to have two different names for the two different hdfs clusters?

@jja725
Copy link
Contributor

jja725 commented Jan 25, 2023

seems like this is more of a feature request. Will close it for now, feel free to reopen it and contact us if this is a strong request!

@jja725 jja725 closed this as completed Jan 25, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
type-bug This issue is about a bug
Projects
None yet
Development

No branches or pull requests

4 participants