[Gluten-986]Align and enrich Scan operator metrics

[Yohahaha]

What changes were proposed in this pull request?

Velox has supports to count scan IO time in this pr facebookincubator/velox#4026.

Gluten's Scan operator lack of scanTime metric, this pr will fix this problem.
Use cpu nanos instead of cpu count.

How was this patch tested?

[github-actions]

Thanks for opening a pull request!

Could you open an issue for this pull request on Github Issues?

https://github.com/oap-project/gluten/issues

Then could you also rename commit message and pull request title in the following format?

[Gluten-${ISSUES_ID}] ${detailed message}

See also:

• Other pull requests

[github-actions]

#986

[rui-mo]

@Yohahaha Thank you. Could you explain a bit why we need to use cpu nanos instead of cpu count ?
cc @FelixYBW

[Yohahaha]

@rui-mo Thanks your reply.
Velox use DeltaCpuWallTimer to calculate the elapsed time in Driver.cpp, count is invoked count, cpuNanos and wallNanos is elapsed time.
https://github.com/facebookincubator/velox/blob/e4a2c99bbf8c61b4cb3edabd5ce1ac25509f0652/velox/common/time/CpuWallTimer.h#L72-L80
https://github.com/facebookincubator/velox/blob/e4a2c99bbf8c61b4cb3edabd5ce1ac25509f0652/velox/common/time/CpuWallTimer.h#L24-L28

[FelixYBW]

@Yohahaha just moted the PR, we use totaltime_xxx to breakdown the operator elapsed time as below. The PR changed all to "cpu time". Can you revert them?

"wallNanos" -> SQLMetrics.createNanoTimingMetric(sparkContext, "totaltime_window"),

[FelixYBW]

totaltime_filter

[FelixYBW]

totaltime_project

[FelixYBW]

totaltime_batchscan

[FelixYBW]

totaltime_expand

[FelixYBW]

here

[FelixYBW]

totaltime_input

[FelixYBW]

here

[FelixYBW]

here

[FelixYBW]

Here

[rui-mo]

@Yohahaha just moted the PR, we use totaltime_xxx to breakdown the operator elapsed time as below. The PR changed all to "cpu time". Can you revert them?

"wallNanos" -> SQLMetrics.createNanoTimingMetric(sparkContext, "totaltime_window"),

@FelixYBW Sorry for the inconvenience, and I will open a PR to change them back.

[Yohahaha]

The PR changed all to "cpu time". Can you revert them?

@FelixYBW Revert wall time or cpu time?

[FelixYBW]

No, let's submit another PR just rename the totaltime related. Other modification are OK

The PR changed all to "cpu time". Can you revert them?

@FelixYBW Revert wall time or cpu time?

[FelixYBW]

The metrics just needs to starts with "totaltime" we can use totaltime to xxx or totaltime of xxx

[FelixYBW]

The tool is upstreamed to Gazelle already, you can find it here: https://github.com/oap-project/gazelle_plugin/tree/main/tools

But Gluten needs some modification, will do later.

[Yohahaha]

@FelixYBW Is any one will submit a pr to do these rename work? I haven't seen the relevant pr, and I could do it.

[rui-mo]

@FelixYBW Is any one will submit a pr to do these rename work? I haven't seen the relevant pr, and I could do it.

@Yohahaha I haven't started this PR. Feel free to do that if it is OK for you. Thanks.