[GH-55] Add realtime metric support. #58

jealous · 2016-11-22T09:38:09Z

Add subscription support for realtime metric.

Details:

List metric resources.
List/Create/Delete metric real time query.
Query metric query result.
Add RepeatedTimer utility for management of repeated tasks.
List disks.
Add calculators meta info manager.
Enable/Disable real time metric collection.
Add metric properties in printed string of resource/resource list.
Add basic persist stats to csv support.

Add following metrics:

disk
- read IOPS
- write IOPS
- read bandwidth
- write bandwidth
- utilization
lun
- read IOPS
- write IOPS
- read bandwidth
- write bandwidth
- utilization
filesystem
- read IOPS
- write IOPS
- read bandwidth
- write bandwidth
storage processor
- net in bandwidth
- net out bandwidth
- block read IOPS
- block write IOPS
- block read bandwidth
- block write bandwidth
- CIFS read IOPS
- CIFS write IOPS
- CIFS read bandwidth
- CIFS write bandwidth
- NFS read IOPS
- NFS write IOPS
- NFS read bandwidth
- NFS write bandwidth
- utilization
- block cache read hit ratio
- block cache write hit ratio

coveralls · 2016-11-22T09:42:50Z

Coverage increased (+0.009%) to 93.097% when pulling 799a9cc on feature/GH-55-unityRealtimeMetric into e797cbd on develop.

coveralls · 2016-11-23T04:10:32Z

Coverage increased (+0.2%) to 93.286% when pulling 7a229fa on feature/GH-55-unityRealtimeMetric into e797cbd on develop.

Tianqi-Tang · 2016-11-22T09:55:23Z

README.rst

@@ -94,10 +94,52 @@ Feature List
        - list/create/delete NFS shares
        - list/create/delete DNS servers
        - list ip ports.
+        - list/create/delete link aggregation


aggregations?

Tianqi-Tang · 2016-11-22T09:55:44Z

README.rst

+        - list/create/delete link aggregation
+        - list/create/delete Consistency Groups
+        - list/create/delete metric real time query
+        - list metric query result


Tianqi-Tang · 2016-11-23T07:26:59Z

storops/lib/common.py

        except OSError as e:
-            # ignore existed error
+            # ignore exited error


Tianqi-Tang · 2016-11-23T07:42:23Z

storops/unity/calculator.py

+
+    def __div__(self, other):
+        nan = self.NaN
+        if other == 0:


Line 105-107 is conflict with login in 97-98

Tianqi-Tang · 2016-11-23T07:42:41Z

storops/unity/calculator.py

+
+    def __rtruediv__(self, other):
+        if other is None:
+            raise ValueError('cannot use none as dividend.')


coveralls · 2016-11-23T10:37:07Z

Coverage increased (+0.2%) to 93.305% when pulling fb5061e on feature/GH-55-unityRealtimeMetric into e797cbd on develop.

peter-wangxu · 2016-11-23T09:58:14Z

storops/unity/calculator.py

@@ -0,0 +1,415 @@
+# coding=utf-8
+# Copyright (c) 2015 EMC Corporation.


peter-wangxu · 2016-11-23T10:24:17Z

storops/unity/resource/disk.py

@@ -0,0 +1,47 @@
+# Copyright (c) 2015 EMC Corporation.


peter-wangxu · 2016-11-23T10:24:52Z

storops/unity/resource/metric.py

@@ -0,0 +1,187 @@
+# coding=utf-8
+# Copyright (c) 2015 EMC Corporation.


peter-wangxu · 2016-11-23T10:27:30Z

storops/unity/resource/metric.py

+            for r in self:
+                self._path_result_map[r.path] = r
+        return self._path_result_map.get(path)
+        # filtered = list(filter(lambda r: r.path == path, self))


unnecessary?

Yes, removed. Thanks.

coveralls · 2016-11-23T11:26:30Z

Coverage increased (+0.2%) to 93.309% when pulling a72270d on feature/GH-55-unityRealtimeMetric into e797cbd on develop.

coveralls · 2016-11-23T13:53:58Z

Coverage increased (+0.3%) to 93.339% when pulling 560569d on feature/GH-55-unityRealtimeMetric into e797cbd on develop.

coveralls · 2016-11-23T14:36:16Z

Coverage increased (+0.2%) to 93.319% when pulling b80bb5a on feature/GH-55-unityRealtimeMetric into e797cbd on develop.

Add subscription support for realtime metric. Details: * List metric resources. * List/Create/Delete metric real time query. * Query metric query result. * Add `RepeatedTimer` utility for management of repeated tasks. * List disks. * Add calculators meta info manager. * Enable/Disable real time metric collection. * Add metric properties in printed string of resource/resource list. * Add basic persist stats to csv support. * Allow enable certain resource types of metrics monitoring. * Add badge from `landscape.io`. Add following metrics: * disk * read IOPS * write IOPS * read bandwidth * write bandwidth * utilization * lun * read IOPS * write IOPS * read bandwidth * write bandwidth * utilization * filesystem * read IOPS * write IOPS * read bandwidth * write bandwidth * storage processor * net in bandwidth * net out bandwidth * block read IOPS * block write IOPS * block read bandwidth * block write bandwidth * CIFS read IOPS * CIFS write IOPS * CIFS read bandwidth * CIFS write bandwidth * NFS read IOPS * NFS write IOPS * NFS read bandwidth * NFS write bandwidth * utilization * block cache read hit ratio * block cache write hit ratio * core count * temperature

coveralls · 2016-11-23T14:52:22Z

Coverage increased (+0.2%) to 93.299% when pulling a92c9b5 on feature/GH-55-unityRealtimeMetric into e797cbd on develop.

Support Link aggregation in storops

[GH 58] Link aggregation

Enhancements: * [GH-46]Support persistent queue for storops * [GH-58] Link aggregation support * [GH-55] Add realtime metric support. (#58) Bugfix: * [GH-40] Add missing keep_for parameter for snap

jealous added enhancement Unity labels Nov 22, 2016

jealous assigned peter-wangxu, Tianqi-Tang and Murray-LIANG Nov 22, 2016

jealous force-pushed the feature/GH-55-unityRealtimeMetric branch from 799a9cc to 7a229fa Compare November 23, 2016 04:05

Tianqi-Tang reviewed Nov 23, 2016

View reviewed changes

jealous force-pushed the feature/GH-55-unityRealtimeMetric branch from 7a229fa to fb5061e Compare November 23, 2016 10:30

peter-wangxu approved these changes Nov 23, 2016

View reviewed changes

jealous force-pushed the feature/GH-55-unityRealtimeMetric branch from fb5061e to a72270d Compare November 23, 2016 11:20

jealous force-pushed the feature/GH-55-unityRealtimeMetric branch from a72270d to 560569d Compare November 23, 2016 13:48

jealous force-pushed the feature/GH-55-unityRealtimeMetric branch from 560569d to b80bb5a Compare November 23, 2016 14:29

jealous force-pushed the feature/GH-55-unityRealtimeMetric branch from b80bb5a to a92c9b5 Compare November 23, 2016 14:43

jealous merged commit 95757b5 into develop Nov 24, 2016

jealous deleted the feature/GH-55-unityRealtimeMetric branch November 24, 2016 06:19

jealous pushed a commit that referenced this pull request Nov 24, 2016

[GH-58] Link aggregation support

1f0a33b

Support Link aggregation in storops

jealous pushed a commit that referenced this pull request Nov 24, 2016

Merge pull request #57 from emc-openstack/feature/GH-58-link-aggregation

e797cbd

[GH 58] Link aggregation

jealous pushed a commit that referenced this pull request Nov 24, 2016

Release 0.3.0

9ea68dc

Enhancements: * [GH-46]Support persistent queue for storops * [GH-58] Link aggregation support * [GH-55] Add realtime metric support. (#58) Bugfix: * [GH-40] Add missing keep_for parameter for snap

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

[GH-55] Add realtime metric support. #58

[GH-55] Add realtime metric support. #58

jealous commented Nov 22, 2016

coveralls commented Nov 22, 2016 •

edited

Loading

coveralls commented Nov 23, 2016 •

edited

Loading

Tianqi-Tang Nov 22, 2016

jealous Nov 23, 2016

Tianqi-Tang Nov 22, 2016

jealous Nov 23, 2016

Tianqi-Tang Nov 23, 2016

jealous Nov 23, 2016

Tianqi-Tang Nov 23, 2016

jealous Nov 23, 2016

Tianqi-Tang Nov 23, 2016

jealous Nov 23, 2016

coveralls commented Nov 23, 2016 •

edited

Loading

peter-wangxu Nov 23, 2016

jealous Nov 23, 2016

peter-wangxu Nov 23, 2016

jealous Nov 23, 2016

peter-wangxu Nov 23, 2016

jealous Nov 23, 2016

peter-wangxu Nov 23, 2016

jealous Nov 23, 2016

coveralls commented Nov 23, 2016 •

edited

Loading

coveralls commented Nov 23, 2016 •

edited

Loading

coveralls commented Nov 23, 2016 •

edited

Loading

coveralls commented Nov 23, 2016 •

edited

Loading

		@@ -0,0 +1,415 @@
		# coding=utf-8
		# Copyright (c) 2015 EMC Corporation.

		@@ -0,0 +1,187 @@
		# coding=utf-8
		# Copyright (c) 2015 EMC Corporation.

[GH-55] Add realtime metric support. #58

[GH-55] Add realtime metric support. #58

Conversation

jealous commented Nov 22, 2016

coveralls commented Nov 22, 2016 • edited Loading

coveralls commented Nov 23, 2016 • edited Loading

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

coveralls commented Nov 23, 2016 • edited Loading

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

coveralls commented Nov 23, 2016 • edited Loading

coveralls commented Nov 23, 2016 • edited Loading

coveralls commented Nov 23, 2016 • edited Loading

coveralls commented Nov 23, 2016 • edited Loading

coveralls commented Nov 22, 2016 •

edited

Loading

coveralls commented Nov 23, 2016 •

edited

Loading

coveralls commented Nov 23, 2016 •

edited

Loading

coveralls commented Nov 23, 2016 •

edited

Loading

coveralls commented Nov 23, 2016 •

edited

Loading

coveralls commented Nov 23, 2016 •

edited

Loading

coveralls commented Nov 23, 2016 •

edited

Loading