Haproxy container can't talk to consul due to SSL certs

[andreimc]

Basically you get some errors when calling consul from haproxy container

2015/05/08 04:13:45 [INFO] (runner) creating new runner (dry: false, once: false)
2015/05/08 04:13:45 [INFO] (runner) creating consul/api client
2015/05/08 04:13:45 [INFO] (runner) creating Watcher
2015/05/08 04:13:45 [INFO] (runner) starting
2015/05/08 04:13:45 [INFO] (runner) running
2015/05/08 04:13:45 [INFO] (runner) was not watching 1 dependencies
2015/05/08 04:13:45 [INFO] (watcher) adding "services"
2015/05/08 04:13:45 [INFO] (runner) diffing and updating dependencies
2015/05/08 04:13:45 [INFO] (runner) watching 1 dependencies
2015/05/08 04:13:45 [ERR] (view) "services" Get https://consul.service.consul:8500/v1/catalog/services?wait=60000ms: x509: failed to load system roots and no roots provided
2015/05/08 04:13:45 [INFO] (view) "services" errored, retrying in 5s
2015/05/08 04:13:45 [ERR] (runner) watcher reported error: Get https://consul.service.consul:8500/v1/catalog/services?wait=60000ms: x509: failed to load system roots and no roots provided
2015/05/08 04:13:45 [INFO] (runner) running
2015/05/08 04:13:45 [INFO] (runner) missing data for 1 dependencies
2015/05/08 04:13:45 [INFO] (runner) diffing and updating dependencies
2015/05/08 04:13:45 [INFO] (runner) watching 1 dependencies
2015/05/08 04:13:50 [ERR] (view) "services" Get https://consul.service.consul:8500/v1/catalog/services?wait=60000ms: x509: failed to load system roots and no roots provided
2015/05/08 04:13:50 [INFO] (view) "services" errored, retrying in 5s
2015/05/08 04:13:50 [ERR] (runner) watcher reported error: Get https://consul.service.consul:8500/v1/catalog/services?wait=60000ms: x509: failed to load system roots and no roots provided
2015/05/08 04:13:50 [INFO] (runner) running
2015/05/08 04:13:50 [INFO] (runner) missing data for 1 dependencies
2015/05/08 04:13:50 [INFO] (runner) diffing and updating dependencies
2015/05/08 04:13:50 [INFO] (runner) watching 1 dependencies
2015/05/08 04:13:55 [ERR] (view) "services" Get https://consul.service.consul:8500/v1/catalog/services?wait=60000ms: x509: failed to load system roots and no roots provided
2015/05/08 04:13:55 [INFO] (view) "services" errored, retrying in 5s
2015/05/08 04:13:55 [ERR] (runner) watcher reported error: Get https://consul.service.consul:8500/v1/catalog/services?wait=60000ms: x509: failed to load system roots and no roots provided
2015/05/08 04:13:55 [INFO] (runner) running
2015/05/08 04:13:55 [INFO] (runner) missing data for 1 dependencies
2015/05/08 04:13:55 [INFO] (runner) diffing and updating dependencies
2015/05/08 04:13:55 [INFO] (runner) watching 1 dependencies
2015/05/08 04:14:00 [ERR] (view) "services" Get https://consul.service.consul:8500/v1/catalog/services?wait=60000ms: x509: failed to load system roots and no roots provided
2015/05/08 04:14:00 [INFO] (view) "services" errored, retrying in 5s
2015/05/08 04:14:00 [ERR] (runner) watcher reported error: Get https://consul.service.consul:8500/v1/catalog/services?wait=60000ms: x509: failed to load system roots and no roots provided
2015/05/08 04:14:00 [INFO] (runner) running
2015/05/08 04:14:00 [INFO] (runner) missing data for 1 dependencies
2015/05/08 04:14:00 [INFO] (runner) diffing and updating dependencies
2015/05/08 04:14:00 [INFO] (runner) watching 1 dependencies
2015/05/08 04:14:05 [ERR] (view) "services" Get https://consul.service.consul:8500/v1/catalog/services?wait=60000ms: x509: failed to load system roots and no roots provided
2015/05/08 04:14:05 [INFO] (view) "services" errored, retrying in 5s
2015/05/08 04:14:05 [ERR] (runner) watcher reported error: Get https://consul.service.consul:8500/v1/catalog/services?wait=60000ms: x509: failed to load system roots and no roots provided
2015/05/08 04:14:05 [INFO] (runner) running
2015/05/08 04:14:05 [INFO] (runner) missing data for 1 dependencies
2015/05/08 04:14:05 [INFO] (runner) diffing and updating dependencies
2015/05/08 04:14:05 [INFO] (runner) watching 1 dependencies
2015/05/08 04:14:10 [ERR] (view) "services" Get https://consul.service.consul:8500/v1/catalog/services?wait=60000ms: x509: failed to load system roots and no roots provided
2015/05/08 04:14:10 [INFO] (view) "services" errored, retrying in 5s
2015/05/08 04:14:10 [ERR] (runner) watcher reported error: Get https://consul.service.consul:8500/v1/catalog/services?wait=60000ms: x509: failed to load system roots and no roots provided
2015/05/08 04:14:10 [INFO] (runner) running
2015/05/08 04:14:10 [INFO] (runner) missing data for 1 dependencies
2015/05/08 04:14:10 [INFO] (runner) diffing and updating dependencies
2015/05/08 04:14:10 [INFO] (runner) watching 1 dependencies
2015/05/08 04:14:15 [ERR] (view) "services" Get https://consul.service.consul:8500/v1/catalog/services?wait=60000ms: x509: failed to load system roots and no roots provided
2015/05/08 04:14:15 [INFO] (view) "services" errored, retrying in 5s
2015/05/08 04:14:15 [ERR] (runner) watcher reported error: Get https://consul.service.consul:8500/v1/catalog/services?wait=60000ms: x509: failed to load system roots and no roots provided
2015/05/08 04:14:15 [INFO] (runner) running
2015/05/08 04:14:15 [INFO] (runner) missing data for 1 dependencies
2015/05/08 04:14:15 [INFO] (runner) diffing and updating dependencies
2015/05/08 04:14:15 [INFO] (runner) watching 1 dependencies
2015/05/08 04:14:20 [ERR] (view) "services" Get https://consul.service.consul:8500/v1/catalog/services?wait=60000ms: x509: failed to load system roots and no roots provided
2015/05/08 04:14:20 [INFO] (view) "services" errored, retrying in 5s
2015/05/08 04:14:20 [ERR] (runner) watcher reported error: Get https://consul.service.consul:8500/v1/catalog/services?wait=60000ms: x509: failed to load system roots and no roots provided
2015/05/08 04:14:20 [INFO] (runner) running
2015/05/08 04:14:20 [INFO] (runner) missing data for 1 dependencies
2015/05/08 04:14:20 [INFO] (runner) diffing and updating dependencies
2015/05/08 04:14:20 [INFO] (runner) watching 1 dependencies
2015/05/08 04:14:25 [ERR] (view) "services" Get https://consul.service.consul:8500/v1/catalog/services?wait=60000ms: x509: failed to load system roots and no roots provided
2015/05/08 04:14:25 [INFO] (view) "services" errored, retrying in 5s
2015/05/08 04:14:25 [ERR] (runner) watcher reported error: Get https://consul.service.consul:8500/v1/catalog/services?wait=60000ms: x509: failed to load system roots and no roots provided
2015/05/08 04:14:25 [INFO] (runner) running
2015/05/08 04:14:25 [INFO] (runner) missing data for 1 dependencies
2015/05/08 04:14:25 [INFO] (runner) diffing and updating dependencies
2015/05/08 04:14:25 [INFO] (runner) watching 1 dependencies
2015/05/08 04:14:30 [ERR] (view) "services" Get https://consul.service.consul:8500/v1/catalog/services?wait=60000ms: x509: failed to load system roots and no roots provided
2015/05/08 04:14:30 [INFO] (view) "services" errored, retrying in 5s
2015/05/08 04:14:30 [ERR] (runner) watcher reported error: Get https://consul.service.consul:8500/v1/catalog/services?wait=60000ms: x509: failed to load system roots and no roots provided
2015/05/08 04:14:30 [INFO] (runner) running
2015/05/08 04:14:30 [INFO] (runner) missing data for 1 dependencies
2015/05/08 04:14:30 [INFO] (runner) diffing and updating dependencies
2015/05/08 04:14:30 [INFO] (runner) watching 1 dependencies

[andreimc]

ok so figured out why haproxy container does not work ... no ca certs and consul over SSL does not work

Solution is to install ca-certificates in docker container also pass the CONTAINER_CONNECT=consult.example.com otherwise it will fail with wrong host

[keithchambers]

Just noticed this issue -- is this a bug in our haproxy container we need to fix?

[BrianHicks]

It is. Would one of you open an issue at CiscoCloud/haproxy-consul and I'll fix it on Monday?

[keithchambers]

@BrianHicks done! Thx!