Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Bug][Doc][Checkpoint storage kerberos]关于checkpoint-storage使用kerberos认证的文档部分描述有误 #6369

Closed
3 tasks done
dzygoon opened this issue Feb 22, 2024 · 4 comments
Labels

Comments

@dzygoon
Copy link
Contributor

dzygoon commented Feb 22, 2024

Search before asking

  • I had searched in the issues and found no similar issues.

What happened

文档中说明,当使用kerberos认证时,配置的一项属性为kerberosKeytab,实际在代码中的属性名为kerberosKeytabFilePath.

SeaTunnel Version

2.3.4

SeaTunnel Config

none.

Running Command

none.

Error Exception

none.

Zeta or Flink or Spark Version

none.

Java or Scala Version

none.

Screenshots

image
1708569136486

Are you willing to submit PR?

  • Yes I am willing to submit a PR!

Code of Conduct

@dzygoon dzygoon added the bug label Feb 22, 2024
@PINK97
Copy link

PINK97 commented Feb 28, 2024

Is the namenode in your cluster in HA mode? If so, please give me your configuration information. I made an error during the configuration process.thx!!!

@dzygoon
Copy link
Contributor Author

dzygoon commented Feb 28, 2024

Is the namenode in your cluster in HA mode? If so, please give me your configuration information. I made an error during the configuration process.thx!!!

官方文档的描述是正确的,我得配置如下:
fs.defaultFS: hdfs://hacluster
seatunnel.hadoop.dfs.nameservices: hacluster
seatunnel.hadoop.dfs.ha.namenodes.hacluster: 37,38
seatunnel.hadoop.dfs.namenode.rpc-address.hacluster.37: rdqh-mrs-testnode02:25000
seatunnel.hadoop.dfs.namenode.rpc-address.hacluster.38: rdqh-mrs-testnode03:25000
seatunnel.hadoop.dfs.client.failover.proxy.provider.hacluster: org.apache.hadoop.hdfs.server.namenode.ha.ConfiguredFailoverProxyProvider

如果你需要使用kerberos认证,那么需要额外添加如下配置:
kerberosPrincipal: rd_hdfs@HADOOP.COM
kerberosKeytabFilePath: /wwdl/resource/huawei_kerberos/user.keytab
seatunnel.hadoop.dfs.namenode.kerberos.principal: hdfs/hadoop.hadoop.com@HADOOP.COM
seatunnel.hadoop.dfs.datanode.kerberos.principal: hdfs/hadoop.hadoop.com@HADOOP.COM
seatunnel.hadoop.rpc.protection: authentication

@dzygoon
Copy link
Contributor Author

dzygoon commented Feb 28, 2024

fix pr #6404

@dzygoon dzygoon closed this as completed Feb 28, 2024
hailin0 pushed a commit that referenced this issue Feb 28, 2024
)

Co-authored-by: dzy <duzhongyuan@wiseweb.com.cn>
@PINK97
Copy link

PINK97 commented Feb 28, 2024

thx!it works!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

2 participants