Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Implement influxdb error reporter #4533

Merged
merged 2 commits into from Aug 31, 2017

Conversation

Projects
None yet
2 participants
@erasche
Copy link
Member

commented Aug 31, 2017

ping @dannon @natefoo One can envision building dashboard like:

auswahl_042

This is created in response to an issue we had where I turned on uwsgi worker auto-killing and it caused a significant increase in number of set metadata tool failures, and they were regular errors too. With a dashboard like this we can get a better view (in conjunction with all of our existing influxdb data / dashboards) of if tool errors are suddenly increasing. Basically it was the easiest way to get this from sentry except in grafana.

auswahl_043

cc @bgruening

@erasche

This comment has been minimized.

Copy link
Member Author

commented Aug 31, 2017

I backported the data using a manually run script, makes for some fun graphs :)

auswahl_044
auswahl_045

And makes it super clear that the metadata setting issues we were seeing were really a new, sudden thing, and due to bad changes to infrastructure.

auswahl_046

dashed lines are annotations. I started adding those as part of our restart.sh script that handles swapping zerglings.

@martenson martenson merged commit 7db1a3f into galaxyproject:dev Aug 31, 2017

6 checks passed

api test Build finished. 284 tests run, 0 skipped, 0 failed.
Details
continuous-integration/travis-ci/pr The Travis CI build passed
Details
framework test Build finished. 161 tests run, 0 skipped, 0 failed.
Details
integration test Build finished. 44 tests run, 0 skipped, 0 failed.
Details
lgtm analysis: JavaScript No alert changes
Details
toolshed test Build finished. 579 tests run, 0 skipped, 0 failed.
Details
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
You can’t perform that action at this time.