New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Consul instead ZooKeeper #479

Open
rnz opened this Issue Feb 10, 2017 · 4 comments

Comments

Projects
None yet
5 participants
@rnz
Copy link

rnz commented Feb 10, 2017

ZooKeeper - need Java VM on every znode, no service discovery, etc ...
Consul - one binary, and other https://www.consul.io/intro/ and https://www.consul.io/intro/vs/zookeeper.html

How about add support Consul as drop-in replacement ZooKeeper?

@alexey-milovidov

This comment has been minimized.

Copy link
Member

alexey-milovidov commented Feb 13, 2017

How about add support Consul as drop-in replacement ZooKeeper?

It is difficult, because we are using ZooKeeper specific functionality like watches, ephemeral nodes, sequential nodes.

Implementing common abstraction on top of ZooKeeper and Consul seems very hard.
Porting code to Consul is possible, but it is not viable, because we are using ZK in our production environment; migration for our clusters is not an option, and even if we will provide possibility of using Consul, we cannot convince ourself that ClickHouse will work reliable with Consul, because it will require very hard testing.

@wakwanza

This comment has been minimized.

Copy link

wakwanza commented Feb 25, 2018

Running a consul based env currently and had the same issue.Setting up a zookeeper cluster seems like introducing many more moving parts into the system.Currently testing out https://github.com/coreos/zetcd which bills itself as:
"A ZooKeeper "personality" for etcd. Point a ZooKeeper client at zetcd to dispatch the operations on an etcd cluster."
Backed by etcd for the k/v store and consul for service discovery.May be of use to @rnz

@filimonov

This comment has been minimized.

Copy link
Contributor

filimonov commented Feb 25, 2018

AFAIK сurrently clickhouse developers have no plans to change ZooKeeper to something else, but ClickHouse is open-source project, and you can try to do it by your own.

@Slach was trying to use ClickHouse with zetcd some time ago, AFAIK - without success, please check #777 and https://github.com/Slach/clickhouse-zetcd

@alexey-milovidov

This comment has been minimized.

Copy link
Member

alexey-milovidov commented Feb 26, 2018

Yes, we still don't have plans to replace ZooKeeper.

Currently we have a plan to rewrite libzookeeper (ZooKeeper C library), because it has many issues.
When we will do it, it will be more viable to plan using another backends.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment