Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Flush Honeybadger events after notify #22205

Merged
merged 1 commit into from
May 4, 2018
Merged

Conversation

ewjordan
Copy link
Contributor

@ewjordan ewjordan commented May 4, 2018

I noticed that we were sometimes dropping reported Honeybadger alerts related to failed cron tasks (our contact rollups task has been failing for a week with an exception, but wasn't showing up in HB); @wjordan suggested that flushing might help, and it appears that it does. This specifically touches the notify_command_error call; I did not do a deep dive into other usages to see if we might be dropping anything else, but this at least should fix the situation for all of our crons.

@ewjordan ewjordan requested review from aoby, wjordan and sureshc May 4, 2018 20:55
Copy link
Contributor

@aoby aoby left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM, but I'm surprised we have to call this. The docs seem to imply it's only needed in tests to force synchronicity. We should report this to Honeybadger support. I'd expect them to auto-flush before the process exits. These cronjobs exit immediately vs. our pegasus and dashboard servers, so those are less likely to need the flush but I'm still concerned now that we might miss notifications in some situations on our front ends (e.g. before a crash or teardown).

@ewjordan
Copy link
Contributor Author

ewjordan commented May 4, 2018

Agreed, this seems odd. I'll mention it in the ticket I opened.

@ewjordan ewjordan merged commit 844cd2c into staging May 4, 2018
@ewjordan ewjordan deleted the flush-honeybadger-events branch May 4, 2018 22:39
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

2 participants