Skip to content

[IOTDB-2963]metrics of process and hardware#5406

Merged
SteveYurongSu merged 16 commits intoapache:masterfrom
ljn55966005:dev-metric
May 16, 2022
Merged

[IOTDB-2963]metrics of process and hardware#5406
SteveYurongSu merged 16 commits intoapache:masterfrom
ljn55966005:dev-metric

Conversation

@ljn55966005
Copy link
Copy Markdown
Contributor

@ljn55966005 ljn55966005 commented Apr 2, 2022

feat:Several new system and process monitoring metrics have been added

Copy link
Copy Markdown

@github-actions github-actions bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Hi, this is your first pull request in IoTDB project. Thanks for your contribution! IoTDB will be better because of you.

Copy link
Copy Markdown
Member

@wangchao316 wangchao316 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

hi, thanks for your contribution.
you could raise a jira, and bind this pr.

Copy link
Copy Markdown
Contributor

@SpriCoder SpriCoder left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Excellent Job! There are only some minor problems need to fix.
Besides, I think some of these metrics should be CORE level, please have a check!
Finally, I think you need to give a performance test after introducing these metrics, so have a try of iotdb-benchmark.

Comment on lines +64 to +67
if (!firstInit.getAndSet(false)) {
startAllReporter();
}

// if (!firstInit.getAndSet(false)) {
startAllReporter();
// }
Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Please do not remove the usage if firstInit parameters, if you user startService of MetricService at first time, you can call startAllReporter() external.

Comment on lines +28 to +31
/**
* @author Erickin
* @create 2022-03-31-上午 8:55
*/
Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Please do not add author and createTime message of class into master branch.

Comment on lines +29 to +32
/**
* @author Erickin
* @create 2022-03-31-下午 3:09
*/
Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Please do not add author and createTime message of class into master branch.

Comment on lines +14 to +17
/**
* @author Erickin
* @create 2022-03-30-下午 3:45
*/
Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Please do not add author and createTime message of class into master branch.

@@ -0,0 +1,53 @@
package org.apache.iotdb.db.metrics;
Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think this file is no need to add into master for test.

Comment on lines +116 to +119
| process_cpu_load | name="process" | important | process当前CPU占用率(%) | process_cpu_load{name="process",} 5.0 |
| process_cpu_time | name="process" | important | process累计占用CPU时间(ns) | process_cpu_time{name="process",} 3.265625E9 |
| sys_cpu_load | name="system" | important | system当前CPU占用率(%) | sys_cpu_load{name="system",} 15.0 |
| sys_cpu_cores | name="system" | important | jvm可用处理器数 | sys_cpu_cores{name="system",} 16.0 |
Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think these metrics should be CORE level.

Comment on lines +126 to +128
| process_max_mem | name="process" | important | process最大可用内存 | process_max_mem{name="process",} 3.545759744E9 |
| process_total_mem | name="process" | important | process当前占用内存 | process_total_mem{name="process",} 2.39599616E8 |
| process_free_mem | name="process" | important | process当前剩余可用内存 | process_free_mem{name="process",} 1.94035584E8 |
Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think these metrics should be CORE level.

@ljn55966005 ljn55966005 changed the title metrics of process and hardware [IOTDB-2963]metrics of process and hardware Apr 20, 2022
Copy link
Copy Markdown
Contributor

@SpriCoder SpriCoder left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM!

Copy link
Copy Markdown
Member

@SteveYurongSu SteveYurongSu left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for your wonderful job :D

BTW, Please merge the upstream master into your branch, the CI fails because of the legacy code on upstream master.

| ---------- | -------------------- | ------ | ----------------------------------- | --------------------------- |
| file_size | name="wal/seq/unseq" | important | 当前时间wal/seq/unseq文件大小(byte) | file_size{name="wal",} 67.0 |
| file_count | name="wal/seq/unseq" | important | 当前时间wal/seq/unseq文件个数 | file_count{name="seq",} 1.0 |
| table_space | name="tablespace" | core | 表空间大小 | table_space{name="tablespace",} 0.0 |
Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

What is the meaning of 表空间大小?

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Please update our English user docs accordingly.

Copy link
Copy Markdown
Member

@SteveYurongSu SteveYurongSu left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@SteveYurongSu SteveYurongSu merged commit 719a77a into apache:master May 16, 2022
SpriCoder pushed a commit to SpriCoder/iotdb that referenced this pull request Jun 8, 2022
Co-authored-by: Erickin <956968575@qq.com>
Co-authored-by: zhengqiang-cisdi <loveher147@qq.com>
(cherry picked from commit 719a77a)
SteveYurongSu pushed a commit that referenced this pull request Jun 8, 2022
…actor from master (#6190)

* [IOTDB-2963] metrics of process and hardware (#5406)

Co-authored-by: Erickin <956968575@qq.com>
Co-authored-by: zhengqiang-cisdi <loveher147@qq.com>
(cherry picked from commit 719a77a)

* remove enable_performance_stat in iotdb-engine.properties, and add enablePerformanceStat in iotdb-metric.yml (#5920)

(cherry picked from commit e108016)

* [IOTDB-3214] Refact predefined metrics in metric framework. (#5930)

(cherry picked from commit dd1a28c)

* [IOTDB-3214] Refact predefined metrics in metric framework. (#5930)

(cherry picked from commit dd1a28c)

* remove empty file.

* fix compile.

Co-authored-by: ljn55966005 <32378956+ljn55966005@users.noreply.github.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

6 participants