Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

当Kafka Broker配置多个安全认证模式时,Kafka Eagle解析Zookeeper上的Broker URL信息失败 #388

Closed
wuwba opened this issue Jul 30, 2020 · 2 comments
Projects

Comments

@wuwba
Copy link

wuwba commented Jul 30, 2020

我们有两套Cluster: ikt和poc

ikt的 Kafka Broker的安全配置如下:
{
"listener_security_protocol_map": {
"SASL_SSL": "SASL_SSL",
"SASL_PLAINTEXT": "SASL_PLAINTEXT"
},
"endpoints": [
"SASL_SSL://10.122.49.167:9092",
"SASL_PLAINTEXT://10.122.49.167:9093"
],
"jmx_port": 9998,
"host": null,
"timestamp": "1594626855533",
"port": -1,
"version": 4
}

poc的broker 配置如下:
{
"listener_security_protocol_map": {
"SASL_PLAINTEXT": "SASL_PLAINTEXT"
},
"endpoints": [
"SASL_PLAINTEXT://10.122.49.174:19093"
],
"jmx_port": 9999,
"host": null,
"timestamp": "1594896610928",
"port": -1,
"version": 4
}

在Kafka Eagle配置文件中配置ZK如下:
kafka.eagle.zk.cluster.alias=ikt,poc
ikt.zk.list=10.122.49.167:2181/kafka210
poc.zk.list=10.122.46.217:12181,10.122.49.173:12181,10.122.49.174:12181

启动Kafka Eagle,poc 的数据正常,连broker成功,但ikt的Load失败,连不上Broker

报如下错:
2020-07-30 17:10:02] BrokerServiceImpl.org.springframework.scheduling.quartz.SchedulerFactoryBean#3_Worker-3 - ERROR - Get topic real logsize has error, msg is No resolvable bootstrap urls given in bootstrap.servers
[2020-07-30 17:10:02] KafkaServiceImpl.org.springframework.scheduling.quartz.SchedulerFactoryBean#3_Worker-3 - ERROR - For input string: "9092","SASL_PLAINTEX"

感觉是当Zookeeper中存的Broker信息,如果endpoints值有两个的话,就会解析错误,变成了"9092","SASL_PLAINTEX"
"endpoints": [
"SASL_SSL://10.122.49.167:9092",
"SASL_PLAINTEXT://10.122.49.167:9093"
],

@wuwba
Copy link
Author

wuwba commented Jul 30, 2020

注明下,我们使用的Kafka Eagle版本是2.0.0

smartloli added a commit that referenced this issue Aug 1, 2020
@smartloli smartloli added this to In progress in v2.0.1 Aug 1, 2020
@smartloli smartloli moved this from In progress to Done in v2.0.1 Aug 1, 2020
@wuwba
Copy link
Author

wuwba commented Aug 27, 2020

已经解决了,用V2.0.1版本,已经能连上我们正式的Kafka Cluster,多谢,太赞了

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
v2.0.1
  
Done
Development

No branches or pull requests

2 participants