Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add aws overview dashboard #12175

Merged
merged 6 commits into from
Jun 25, 2019
Merged

Add aws overview dashboard #12175

merged 6 commits into from
Jun 25, 2019

Conversation

kaiyan-sheng
Copy link
Contributor

@kaiyan-sheng kaiyan-sheng commented May 10, 2019

With cloudwatch metricset merged, we can collect a lot of useful metrics from cloudwatch from different namespaces. Here is an example aws overview dashboard which includes metrics from EC2, SQS, S3, ECS, ELB and Lambda:
localhost_5601_app_kibana (10)

closes: #11007

@kaiyan-sheng kaiyan-sheng requested review from a team as code owners May 10, 2019 19:30
@kaiyan-sheng kaiyan-sheng self-assigned this May 10, 2019
@kaiyan-sheng kaiyan-sheng added the Team:Integrations Label for the Integrations team label May 10, 2019
@kaiyan-sheng
Copy link
Contributor Author

For some reason, I can no longer import the dashboard json file after I created #12157. So this PR is to replace it.

@kaiyan-sheng kaiyan-sheng added [zube]: In Review in progress Pull request is currently in progress. and removed [zube]: In Review labels May 10, 2019
@sayden
Copy link
Contributor

sayden commented May 27, 2019

I checked locally and it seems some kind of error when trying to load the dashboard

image

@kaiyan-sheng kaiyan-sheng added in progress Pull request is currently in progress. [zube]: In Review review and removed [zube]: In Review review in progress Pull request is currently in progress. labels Jun 14, 2019
@kaiyan-sheng
Copy link
Contributor Author

kaiyan-sheng commented Jun 18, 2019

I think I mentioned my question to @exekias @sayden before but I think I should post it here:
I created ECS CPU Available (and ECS Memory Available) in the overview dashboard instead of two separate virtualization: CPUReservation and CPUUtilization. Does it make sense?
Cloudwatch gives CPUReservation and CPUUtilization, as well as MemoryReservation and MemoryUtilization.

ECS CPU Available = ECS CPUReservation - ECS CPUUtilization
CPUReservation: The percentage of CPU units that are reserved by running tasks in the cluster.
CPUUtilization: The percentage of CPU units that are used in the cluster or service.

For example, for one of the cluster I can see, CPUReservation = 0.781(percent) and CPUUtilization = 0.376(percent) from AWS Cloudwatch:
Screen Shot 2019-06-18 at 12 09 50 PM

@sayden
Copy link
Contributor

sayden commented Jun 19, 2019

@kaiyan-sheng and me talked shortly about the naming and I also think that the naming and grouping Kaiyan is proposing is perfect

@kaiyan-sheng
Copy link
Contributor Author

@sayden @exekias I think this one is ready to get in. This suppose to be an example to show users how or what they can do with cloudwatch metricset. It's not suppose to be something user will 100% use for overview with their use case. So my thought is, if no error loading the dashboard, then we can merge it 😬 What do you guys think?

@exekias
Copy link
Contributor

exekias commented Jun 25, 2019

SGTM, as we advance with modules this dashboard could keep evolving to become more of an inventory view linking to detailed dashboards per module

@kaiyan-sheng
Copy link
Contributor Author

Sounds good to me. I just tested this again and should load just fine.

@kaiyan-sheng kaiyan-sheng merged commit 0dded5d into elastic:master Jun 25, 2019
@kaiyan-sheng kaiyan-sheng deleted the aws_overview_dashboard branch June 25, 2019 13:20
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
review Team:Integrations Label for the Integrations team
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Add a dashboard for AWS metricbeat module
4 participants