Metric rollups at the Service level #15695

jntullo · 2017-07-31T18:44:34Z

This adds metric rollups at the service level from a service's VMs

@miq-bot add_label wip, services, enhancement

daily sample:

 #<MetricRollup:0x007f853471fcd0
 id: 10000001262445,
 timestamp: Mon, 07 Aug 2017 00:00:00 UTC +00:00,
 capture_interval: 86400,
 resource_type: "Service",
 resource_id: 10000000000540,
 cpu_usage_rate_average: 0.215822872211595,
 cpu_usagemhz_rate_average: 0.0,
 mem_usage_absolute_average: 0.0,
 disk_usage_rate_average: 0.0,
 net_usage_rate_average: 0.274660377872475,
 sys_uptime_absolute_latest: 0.0,
 created_on: Mon, 07 Aug 2017 17:57:28 UTC +00:00,
 derived_cpu_available: 0.0,
 derived_memory_available: 1024.0,
 derived_memory_used: 0.0,
 derived_cpu_reserved: 0.0,
 derived_memory_reserved: 0.0,
 derived_vm_count_on: 2,
 derived_host_count_on: 0,
 derived_vm_count_off: 0,
 derived_host_count_off: 0,
 derived_storage_total: 0.0,
 derived_storage_free: 0.0,
 capture_interval_name: "daily",
 assoc_ids: {:vms=>{:on=>[10000000003077, 10000000003090], :off=>[]}},
 cpu_ready_delta_summation: 0.0,
 cpu_system_delta_summation: 0.0,
 cpu_wait_delta_summation: 0.0,
 resource_name: "jill-metrics-testing",
 cpu_used_delta_summation: 0.0,
 tag_names: "environment/dev|function/app",
 parent_host_id: nil,
 parent_ems_cluster_id: nil,
 parent_storage_id: nil,
 parent_ems_id: nil,
 derived_storage_vm_count_registered: 0.0,
 derived_storage_vm_count_unregistered: 0.0,
 derived_storage_vm_count_unmanaged: 0.0,
 derived_storage_used_registered: 0.0,
 derived_storage_used_unregistered: 0.0,
 derived_storage_used_unmanaged: 0.0,
 derived_storage_snapshot_registered: 0.0,
 derived_storage_snapshot_unregistered: 0.0,
 derived_storage_snapshot_unmanaged: 0.0,
 derived_storage_mem_registered: 0.0,
 derived_storage_mem_unregistered: 0.0,
 derived_storage_mem_unmanaged: 0.0,
 derived_storage_disk_registered: 0.0,
 derived_storage_disk_unregistered: 0.0,
 derived_storage_disk_unmanaged: 0.0,
 derived_storage_vm_count_managed: 0.0,
 derived_storage_used_managed: 0.0,
 derived_storage_snapshot_managed: 0.0,
 derived_storage_mem_managed: 0.0,
 derived_storage_disk_managed: 0.0,
 min_max:
  {:min_cpu_usage_rate_average=>0.201016666666667,
   :max_cpu_usage_rate_average=>0.310938888888889,
   :min_cpu_usagemhz_rate_average=>0.0,
   :max_cpu_usagemhz_rate_average=>0.0,
   :min_mem_usage_absolute_average=>0.0,
   :max_mem_usage_absolute_average=>0.0,
   :min_disk_usage_rate_average=>0.0,
   :max_disk_usage_rate_average=>0.0,
   :min_net_usage_rate_average=>0.153255447048611,
   :max_net_usage_rate_average=>0.491146057581019,
   :min_derived_memory_available=>1024.0,
   :max_derived_memory_available=>1024.0,
   :min_derived_memory_used=>0.0,
   :max_derived_memory_used=>0.0,
   :min_derived_vm_count_on=>2.0,
   :max_derived_vm_count_on=>2.0,
   :min_derived_host_count_on=>0.0,
   :max_derived_host_count_on=>0.0,
   :min_derived_vm_count_off=>0.0,
   :max_derived_vm_count_off=>0.0,
   :min_derived_host_count_off=>0.0,
   :max_derived_host_count_off=>0.0,
   :min_cpu_ready_delta_summation=>0.0,
   :max_cpu_ready_delta_summation=>0.0,
   :min_cpu_system_delta_summation=>0.0,
   :max_cpu_system_delta_summation=>0.0,
   :min_cpu_wait_delta_summation=>0.0,
   :max_cpu_wait_delta_summation=>0.0,
   :min_cpu_used_delta_summation=>0.0,
   :max_cpu_used_delta_summation=>0.0,
   :min_disk_devicelatency_absolute_average=>0.0,
   :max_disk_devicelatency_absolute_average=>0.0,
   :min_disk_kernellatency_absolute_average=>0.0,
   :max_disk_kernellatency_absolute_average=>0.0,
   :min_disk_queuelatency_absolute_average=>0.0,
   :max_disk_queuelatency_absolute_average=>0.0,
   :min_derived_vm_used_disk_storage=>17179869184.0,
   :max_derived_vm_used_disk_storage=>17179869184.0,
   :min_derived_vm_allocated_disk_storage=>17179869184.0,
   :max_derived_vm_allocated_disk_storage=>17179869184.0,
   :min_derived_vm_numvcpus=>2.0,
   :max_derived_vm_numvcpus=>2.0,
   :min_derived_host_count_total=>0.0,
   :max_derived_host_count_total=>0.0,
   :min_derived_vm_count_total=>2.0,
   :max_derived_vm_count_total=>2.0},
 intervals_in_rollup: 18,
 mem_vmmemctl_absolute_average: 0.0,
 mem_vmmemctltarget_absolute_average: 0.0,
 mem_swapin_absolute_average: 0.0,
 mem_swapout_absolute_average: 0.0,
 mem_swapped_absolute_average: 0.0,
 mem_swaptarget_absolute_average: 0.0,
 disk_devicelatency_absolute_average: 0.0,
 disk_kernellatency_absolute_average: 0.0,
 disk_queuelatency_absolute_average: 0.0,
 derived_vm_used_disk_storage: 17179869184.0,
 derived_vm_allocated_disk_storage: 17179869184.0,
 derived_vm_numvcpus: 2.0,
 time_profile_id: 10000000000001,
 derived_host_sockets: 0,
 derived_host_count_total: 0,
 derived_vm_count_total: 2,
 stat_container_group_create_rate: 0,
 stat_container_group_delete_rate: 0,
 stat_container_image_registration_rate: 0>

hourly sample:

 #<MetricRollup:0x007f853a616a40
 id: 10000001262309,
 timestamp: Mon, 07 Aug 2017 17:00:00 UTC +00:00,
 capture_interval: nil,
 resource_type: "Service",
 resource_id: 10000000000540,
 cpu_usage_rate_average: 0.222178366475377,
 cpu_usagemhz_rate_average: 0.0,
 mem_usage_absolute_average: 0.0,
 disk_usage_rate_average: 0.0,
 net_usage_rate_average: 0.312048918313343,
 sys_uptime_absolute_latest: nil,
 created_on: Mon, 07 Aug 2017 17:56:21 UTC +00:00,
 derived_cpu_available: nil,
 derived_memory_available: 1024.0,
 derived_memory_used: 0.0,
 derived_cpu_reserved: nil,
 derived_memory_reserved: nil,
 derived_vm_count_on: 2,
 derived_host_count_on: 0,
 derived_vm_count_off: 0,
 derived_host_count_off: 0,
 derived_storage_total: nil,
 derived_storage_free: nil,
 capture_interval_name: "hourly",
 assoc_ids: {:vms=>{:on=>[10000000003077, 10000000003090], :off=>[]}},
 cpu_ready_delta_summation: 0.0,
 cpu_system_delta_summation: 0.0,
 cpu_wait_delta_summation: 0.0,
 resource_name: "jill-metrics-testing",
 cpu_used_delta_summation: 0.0,
 tag_names: "environment/dev|function/app",
 parent_host_id: nil,
 parent_ems_cluster_id: nil,
 parent_storage_id: nil,
 parent_ems_id: nil,
 derived_storage_vm_count_registered: nil,
 derived_storage_vm_count_unregistered: nil,
 derived_storage_vm_count_unmanaged: nil,
 derived_storage_used_registered: nil,
 derived_storage_used_unregistered: nil,
 derived_storage_used_unmanaged: nil,
 derived_storage_snapshot_registered: nil,
 derived_storage_snapshot_unregistered: nil,
 derived_storage_snapshot_unmanaged: nil,
 derived_storage_mem_registered: nil,
 derived_storage_mem_unregistered: nil,
 derived_storage_mem_unmanaged: nil,
 derived_storage_disk_registered: nil,
 derived_storage_disk_unregistered: nil,
 derived_storage_disk_unmanaged: nil,
 derived_storage_vm_count_managed: nil,
 derived_storage_used_managed: nil,
 derived_storage_snapshot_managed: nil,
 derived_storage_mem_managed: nil,
 derived_storage_disk_managed: nil,
 min_max: nil,
 intervals_in_rollup: nil,
 mem_vmmemctl_absolute_average: nil,
 mem_vmmemctltarget_absolute_average: nil,
 mem_swapin_absolute_average: nil,
 mem_swapout_absolute_average: nil,
 mem_swapped_absolute_average: nil,
 mem_swaptarget_absolute_average: nil,
 disk_devicelatency_absolute_average: 0.0,
 disk_kernellatency_absolute_average: 0.0,
 disk_queuelatency_absolute_average: 0.0,
 derived_vm_used_disk_storage: 17179869184.0,
 derived_vm_allocated_disk_storage: 17179869184.0,
 derived_vm_numvcpus: 2.0,
 time_profile_id: nil,
 derived_host_sockets: nil,
 derived_host_count_total: 0,
 derived_vm_count_total: 2,
 stat_container_group_create_rate: nil,
 stat_container_group_delete_rate: nil,
 stat_container_image_registration_rate: nil>

jntullo · 2017-08-01T18:37:02Z

@miq-bot remove_label wip

additional specs

miq-bot · 2017-08-01T19:52:52Z

Checked commits jntullo/manageiq@4cecda8~...543e5a7 with ruby 2.2.6, rubocop 0.47.1, and haml-lint 0.20.0
11 files checked, 0 offenses detected
Everything looks fine. 🏆

gtanzillo

Looks good! 👍

miq-bot added enhancement lifecycle/services wip labels Jul 31, 2017

Jillian Tullo added 2 commits July 31, 2017 14:59

add metric rollups at the service level

4cecda8

derived column services spec

125c788

chessbyte assigned gtanzillo Aug 1, 2017

miq-bot changed the title ~~[WIP] Metric rollups at the Service level~~ Metric rollups at the Service level Aug 1, 2017

miq-bot removed the wip label Aug 1, 2017

fix daily rollups

543e5a7

additional specs

gtanzillo approved these changes Aug 8, 2017

View reviewed changes

gtanzillo added this to the Sprint 66 Ending Aug 7, 2017 milestone Aug 8, 2017

gtanzillo merged commit 9961d46 into ManageIQ:master Aug 8, 2017

NickLaMuro mentioned this pull request Aug 14, 2017

[WIP] Refactor Metric::Processing.process_derived_columns to use less memory #15757

Closed

AllenBW mentioned this pull request Sep 20, 2017

Resource Details Page - ie: bulk cards, everything is a card ManageIQ/manageiq-ui-service#910

Merged

10 tasks

jntullo deleted the enhancement/service_metric_rollups branch November 28, 2017 19:41

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Metric rollups at the Service level #15695

Metric rollups at the Service level #15695

jntullo commented Jul 31, 2017 •

edited

Loading

jntullo commented Aug 1, 2017

miq-bot commented Aug 1, 2017

gtanzillo left a comment

Metric rollups at the Service level #15695

Metric rollups at the Service level #15695

Conversation

jntullo commented Jul 31, 2017 • edited Loading

jntullo commented Aug 1, 2017

miq-bot commented Aug 1, 2017

gtanzillo left a comment

Choose a reason for hiding this comment

jntullo commented Jul 31, 2017 •

edited

Loading