Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[FEATURE] HDFS storage support NameNode HA config #1846

Closed
zhengshubin opened this issue Aug 28, 2023 · 1 comment
Closed

[FEATURE] HDFS storage support NameNode HA config #1846

zhengshubin opened this issue Aug 28, 2023 · 1 comment

Comments

@zhengshubin
Copy link

Is your feature request related to a problem? Please describe.

A clear and concise description of what the problem is. Ex. I'm always frustrated when [...]
I have a hadoop cluster with namemode ha ,but it make errror when I use namenode ha config.

Describe the solution you'd like

A clear and concise description of what you want to happen.
HDFS storage support NameNode HA config

Describe alternatives you've considered

A clear and concise description of any alternative solutions or features you've considered.
Like doris hdfs ha config :
"dfs.nameservices" = "my_hdfs",
"dfs.ha.namenodes.my_hdfs" = "nn1,nn2",
"dfs.namenode.rpc-address.my_hdfs.nn1" = "nanmenode01:8020",
"dfs.namenode.rpc-address.my_hdfs.nn2" = "nanmenode02:8020",
"dfs.client.failover.proxy.provider.my_hdfs" = "org.apache.hadoop.hdfs.server.namenode.ha.ConfiguredFailoverProxyProvider")
or put the hdfs-site.xml to config path and read it automatically.
/cc @who-need-to-know

/assign @who-can-help-you

@waitinfuture
Copy link
Contributor

Hi @zhengshubin , you can pass hadoop related configs using celeborn.hadoop.xxx

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants