-
Notifications
You must be signed in to change notification settings - Fork 66
serve conf pages on the cluster's virtual ip address #1244
Conversation
Will add port 60301 for hbase workers and 1006 for hdfs workers. |
Please use the standard ports and please do not make up a new convention. We already have enough confusion with the accident of 11010. Nothing should be listening on the VIP for 16010, 60300, nor 50070. |
yes, it make sense. I have observed some issue that HBase is binding to 0.0.0.0 which should be fixed first. |
option httpchk GET /jmx | ||
http-check expect string tag.isActiveMaster"\ :\ "true | ||
<% @hbase_servers.each do |server| -%> | ||
<%= "server #{server['hostname']} #{server['bcpc']['management']['ip']}:16010 check" %> |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Can we get the port number from an attribute?
option httpchk GET /jmx | ||
http-check expect string tag.HAState"\ :\ "active | ||
<% @hdfs_servers.each do |server| -%> | ||
<%= "server #{server['hostname']} #{server['bcpc']['floating']['ip']}:50070 check" %> |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
NN port number from an attribute? Also, all other ports in haproxy
.
@@ -74,3 +76,21 @@ backend backend_oozie | |||
<%= "server #{float_host(server[:fqdn])} #{server['bcpc']['floating']['ip']}:11000 check" %> | |||
<% end -%> | |||
<% end -%> | |||
|
|||
# hdfs conf page |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
We should not call this the conf page
but instead hdfs master or some such
may need to redirect. |
Updates to |
working on remove the circular dependency between bcpc:haproxy and bcpc-hadoop ... |
Services should not bind to vip (#1258) Also, as Biju has pointed out, circular dependency should be avoided. I'm going to add attributes in haproxy cookbook which are going to be overridden in bcpc-hadoop cookbook. |
@leochen4891 For simplicity's sake you could have had an haproxy configuration that listens on some designated port XXXX and elected to use a conventions such as |
Thanks for the suggestions. I have put the change to a new PR. #1269 Closing this one. |
This is to make conf pages HA available on the cluster's virtual ip.
Each each conf page is identified by the port number.
e.g.
HDFS: http://10.0.100.5:50071/conf
HBase: http://10.0.100.5:16011/conf
More pages will be added in the future (e.g. Yarn)
Ready for review.