We currently use TimeMonitor.java and MeasureTime.py DoFns to collect runtime in both portable and non-portable performance tests. However, in portable tests it seems to be possible to use TOTAL_TIME_MSECS for collecting execution time. Other system metrics are available as well (size, bundle size etc).
It seems like a good way to simplify things and get more useful metrics from portable jobs so it is worth investigating ways of using it in performance tests.
Imported from Jira BEAM-8826. Original Jira may contain additional context.
Reported by: ŁukaszG.
We currently use TimeMonitor.java and MeasureTime.py DoFns to collect runtime in both portable and non-portable performance tests. However, in portable tests it seems to be possible to use TOTAL_TIME_MSECS for collecting execution time. Other system metrics are available as well (size, bundle size etc).
It seems like a good way to simplify things and get more useful metrics from portable jobs so it is worth investigating ways of using it in performance tests.
Imported from Jira BEAM-8826. Original Jira may contain additional context.
Reported by: ŁukaszG.