No operations per second

[hansbogert]

In the screenshots of the README.md we can see the operations-per-second metric. Is it expected that this metric can't be seen in a default deployment?

[hansbogert]

Update:
It seems that if there are no IOPS at the moment that you load the dashboard, that the metrics are not shown at all. Even if IOPS should be happening at a later moment in time, the metrics will not be shown until you refresh the dash page.

[Crapworks]

Hi @hansbogert,

this should not happens since the JS routine to render the page is called every 5 seconds by default. Can you tell me which version of ceph you are using and can you provide the output of

ceph status --format=json-pretty

Regards,
Christian

[Crapworks]

I also just changed something in the JS code regarding the changed json structure in the jewel release. Can you pull the latest code and check if the problem is still there?

[hansbogert]

Ceph version:

sudo dpkg --status ceph-base
Package: ceph-base
Status: install ok installed
Priority: optional
Section: admin
Installed-Size: 318045
Maintainer: Ceph Maintainers <ceph-maintainers@lists.ceph.com>
Architecture: amd64
Source: ceph
Version: 10.2.3-1xenial

---

{
    "health": {
        "health": {
            "health_services": [
                {
                    "mons": [
                        {
                            "name": "mon01",
                            "kb_total": 280000488,
                            "kb_used": 5352660,
                            "kb_avail": 260401532,
                            "avail_percent": 93,
                            "last_updated": "2017-01-08 13:40:11.122534",
                            "store_stats": {
                                "bytes_total": 93630079,
                                "bytes_sst": 0,
                                "bytes_log": 3146509,
                                "bytes_misc": 90483570,
                                "last_updated": "0.000000"
                            },
                            "health": "HEALTH_OK"
                        },
                        {
                            "name": "mon02",
                            "kb_total": 280000488,
                            "kb_used": 6516844,
                            "kb_avail": 259237348,
                            "avail_percent": 92,
                            "last_updated": "2017-01-08 13:39:46.632191",
                            "store_stats": {
                                "bytes_total": 94147847,
                                "bytes_sst": 0,
                                "bytes_log": 3549438,
                                "bytes_misc": 90598409,
                                "last_updated": "0.000000"
                            },
                            "health": "HEALTH_OK"
                        },
                        {
                            "name": "mon03",
                            "kb_total": 280000488,
                            "kb_used": 6465676,
                            "kb_avail": 259288516,
                            "avail_percent": 92,
                            "last_updated": "2017-01-08 13:39:45.414836",
                            "store_stats": {
                                "bytes_total": 95245361,
                                "bytes_sst": 0,
                                "bytes_log": 3450789,
                                "bytes_misc": 91794572,
                                "last_updated": "0.000000"
                            },
                            "health": "HEALTH_OK"
                        }
                    ]
                }
            ]
        },
        "timechecks": {
            "epoch": 56,
            "round": 54174,
            "round_status": "finished",
            "mons": [
                {
                    "name": "mon01",
                    "skew": 0.000000,
                    "latency": 0.000000,
                    "health": "HEALTH_OK"
                },
                {
                    "name": "mon02",
                    "skew": 0.000000,                                                                                                                                   
                    "latency": 0.000345,
                    "health": "HEALTH_OK"
                },
                {
                    "name": "mon03",
                    "skew": 0.000000,
                    "latency": 0.000351,
                    "health": "HEALTH_OK"
                }
            ]
        },
        "summary": [],
        "overall_status": "HEALTH_OK",
        "detail": []
    },
    "fsid": "9662efc5-2acd-4218-8ea1-ef37c3363d4a",
    "election_epoch": 56,
    "quorum": [
        0,
        1,
        2
    ],
    "quorum_names": [
        "mon01",
        "mon02",
        "mon03"
    ],
    "monmap": {
        "epoch": 1,
        "fsid": "9662efc5-2acd-4218-8ea1-ef37c3363d4a",
        "modified": "2016-07-14 14:46:24.315073",
        "created": "2016-07-14 14:46:24.315073",
        "mons": [
            {
                "rank": 0,
                "name": "mon01",
                "addr": "10.20.20.207:6789\/0"
            },
            {
                "rank": 1,
                "name": "mon02",
                "addr": "10.20.20.208:6789\/0"
            },
            {
                "rank": 2,
                "name": "mon03",
                "addr": "10.20.20.209:6789\/0"
            }
        ]
    },
    "osdmap": {
        "osdmap": {
            "epoch": 3848,
            "num_osds": 39,
            "num_up_osds": 39,
            "num_in_osds": 39,
            "full": false,
            "nearfull": false,
            "num_remapped_pgs": 0
        }
    },
    "pgmap": {
        "pgs_by_state": [
            {
                "state_name": "active+clean",
                "count": 1608
            }
        ],
        "version": 9910325,
        "num_pgs": 1608,
        "data_bytes": 1110408462299,
        "bytes_used": 3349436145664,
        "bytes_avail": 74628028448768,
        "bytes_total": 77977464594432,
        "write_bytes_sec": 2042,
        "read_op_per_sec": 0,
        "write_op_per_sec": 0
    },
    "fsmap": {
        "epoch": 1,
        "by_rank": []
    }
}

---

Pulled new version, following happens now, indeed a 3rd field appears with "operations/second":

After update of the ops, the field actually disappears:

[Crapworks]

Hi @hansbogert

thanks for the infos! I probably found the error. Can you pull the latest code and try again?

Cheers,
Christian

[hansbogert]

Seems to do the trick. Now updates correctly from a 1-cell row "operations / second" to a 2-cell row with "write ops / second" and "read ops / second".

[hansbogert]

Well, it works well, just one small thing. If I'm correct, the ops cells do not get updated to "0" after activity, but during idle periods.

[Crapworks]

You mean the "write ops" field stays at "5"? it is normal that ceph reports iops after write/reads are only done, but only one or two seconds.

[hansbogert]

Yeah this stays indefinitely if there isn’t any ops or byte transfer afterwards.

…

On Jan 10, 2017, at 11:56 AM, Christian Eichelmann ***@***.***> wrote: You mean the "write ops" field stays at "5"? it is normal that ceph reports iops after write/reads are only done, but only one or two seconds. — You are receiving this because you modified the open/close state. Reply to this email directly, view it on GitHub <#44 (comment)>, or mute the thread <https://github.com/notifications/unsubscribe-auth/ACgk9BuC0iW08fJOOUB9AmV-ZFgBh7PVks5rQ2POgaJpZM4Ka5Bc>.

[Crapworks]

Ok, i've checked the whole code again with a mocked ceph backend. It works for me now. Can you pull the latest code and give it a try again?

[hansbogert]

Awesome!