This repository has been archived by the owner on May 12, 2021. It is now read-only.
-
Notifications
You must be signed in to change notification settings - Fork 512
DO NOT MERGE METRON-745: Create Error Dashboards #469
Closed
Closed
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
# Conflicts: # metron-platform/metron-enrichment/src/test/java/org/apache/metron/enrichment/integration/EnrichmentIntegrationTest.java # metron-platform/metron-parsers/src/main/java/org/apache/metron/parsers/bolt/ParserBolt.java # metron-platform/metron-parsers/src/test/java/org/apache/metron/parsers/bolt/ParserBoltTest.java
… added tests and javadocs for MessageGetters and commented out rawMessageBytes field
# Conflicts: # metron-platform/metron-common/pom.xml
justinleet
force-pushed
the
dashboards-695
branch
from
March 6, 2017 21:42
437561a
to
4fe9340
Compare
I'm going to just close this and open a new, much, much cleaner one. |
Sign up for free
to subscribe to this conversation on GitHub.
Already have an account?
Sign in.
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
DO NOT MERGE
Summary
Based on Ryan's work in #453, I went ahead and created some a Kibana dashboard for tracking errors. That PR is not finalized in master so this should not be merged! However, the data flowing to the index is pretty final, so unless the actual fields or field names change, it doesn't really affect this.
All we care about here is the dashboard itself, but unfortunately the 453 changes get pulled along for the ride until that's in.
It's nothing too complicated, essentially just some high level overviews of the various fields output by Ryan (some counts, etc.), along with a pane for viewing the actual errors along with all their fields. Note that they include both raw and unique message counts (via the hash fields) in most things.
I've attached some screenshots, but this can be also be spun up on an Ambari cluster (and will eventually have to be to be validated, given that the file isn't in a readable format).
I'm basically looking for feedback on what else would be useful and if we want to adjust anything. Keep in mind, we don't actually have a lot of fields to work with (because if everything was good, we wouldn't be here in the first place!). See error_index.template for the fields we have.
Notes
The bottom pane extends further down, but we've all seen a table of data before.
For all changes:
For code changes:
For documentation related changes:
Note:
Please ensure that once the PR is submitted, you check travis-ci for build issues and submit an update to your PR as soon as possible.
It is also recommened that travis-ci is set up for your personal repository such that your branches are built there before submitting a pull request.