[BEAM-5837] Add dashboard for monitoring input data staleness#6820
Merged
swegner merged 5 commits intoapache:masterfrom Oct 26, 2018
Merged
[BEAM-5837] Add dashboard for monitoring input data staleness#6820swegner merged 5 commits intoapache:masterfrom
swegner merged 5 commits intoapache:masterfrom
Conversation
Contributor
Author
|
R: @Ardagan |
swegner
force-pushed
the
staleness_dashboard
branch
from
d7415b5 to
ee18f01
Compare
Contributor
Author
This will make it easier to monitor whether we have fresh input data in in our dashboards. We can set up notifications or probing against the dahsboard alerts.
swegner
force-pushed
the
staleness_dashboard
branch
from
ee18f01 to
da19d3d
Compare
Contributor
Author
|
The alert needs to be changed to 8 hours instead of mins |
Ardagan
requested changes
Oct 24, 2018
Contributor
Ardagan
left a comment
Ardagan
left a comment
There was a problem hiding this comment.
Also dashboard should alert on more than 8 minutes. Even though we run sync scripts every 5 mins, this will change for GHA script.
Also we get timing for Jenkins jobs based on duration, so we can have longer intervals there.
I suggest to set it to 8 hours, this will cover period of jenkins jobs kick off that is 6 hours.
Co-Authored-By: swegner <scott@apache.org>
Contributor
Author
|
Feedback addressed; @Ardagan PTAL |
Ardagan
approved these changes
Oct 25, 2018
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
2 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
This will make it easier to monitor whether we have fresh input data in
in our dashboards. We can set up notifications or probing against the
dahsboard alerts.
Follow this checklist to help us incorporate your contribution quickly and easily:
[BEAM-XXX] Fixes bug in ApproximateQuantiles, where you replaceBEAM-XXXwith the appropriate JIRA issue, if applicable. This will automatically link the pull request to the issue.It will help us expedite review of your Pull Request if you tag someone (e.g.
@username) to look at it.Post-Commit Tests Status (on master branch)