Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Front50's health check fails if Redis is not running locally #1018

Closed
gkuchta opened this issue Jul 25, 2016 · 4 comments
Closed

Front50's health check fails if Redis is not running locally #1018

gkuchta opened this issue Jul 25, 2016 · 4 comments
Assignees

Comments

@gkuchta
Copy link

gkuchta commented Jul 25, 2016

Issue

Front50's health check fails if Redis is not installed/running locally. It appears that this is due to springboot's org.springframework.boot.actuate.health.RedisHealthIndicator bubbling up to the surface.

Expected behavior

With "spinnaker.redis.enabled" : false and Front50 configured to use S3 for persistence, we had expected that http://localhost:8080/health would return UP if the S3 check passed. Instead, it returned DOWN, despite S3 working correctly. (ie: we could create pipelines, applications, etc, and see them populating the S3 bucket)

Steps to reproduce

  • Tell Front50 NOT to use Redis.
  • Stop the Redis instance running locally.
  • curl http://localhost:8080/health -- it will report DOWN
  • Re-start Redis
  • curl http://localhost:8080/health -- it will report UP
  • netstat -atnp | grep 6379 will show connections from the Front50 JVM to Redis.

Remediation

We were able to disable the springboot health check in front50-local.yml, though it might be useful to add this to the default configuration.

management:
  health:
    redis:
      enabled: false
@TheDigitalNinja
Copy link
Contributor

I experienced the exact same issue today and can confirm that the above config change worked for us.

@iandelahorne
Copy link

I experienced the same issue, and the above fix helped. It doesn't return UP immediately after boot which can be confusing while debugging. Looking at S3Support.java:100 this seems to be 45 seconds due to the timeout.

@ttomsu
Copy link
Member

ttomsu commented Nov 28, 2016

Just got bit by this too. @gregturn, can you but a conditional on this?

gregturn added a commit to gregturn/front50 that referenced this issue Dec 19, 2016
Spring Boot has a builtin RedisHealthCheck. It must be disabled if redis support is also disabled.

Resolves spinnaker/spinnaker#1018
@ttomsu
Copy link
Member

ttomsu commented Dec 19, 2016

Thanks, @gregturn !

spinnaker/front50#174

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

5 participants