Compare various KPIs to the threshold values and fail if any is crossed

[pmacik]

Signed-off-by: Pavel Macík pavel.macik@gmail.com

Changes

This PR:

• Introduces test-performance-thresholds Makefile targed that compares various vaules from kpi.yaml generated by make test-performance-collect-kpi to the threshold values defined in environment variables TEST_PERFORMANCE_AVG_MEMORY, TEST_PERFORMANCE_MAX_MEMORY, TEST_PERFORMANCE_AVG_CPU, TEST_PERFORMANCE_MAX_CPU. If any of the threshold is crossed it fails.
• The test-performance-thresholds is to be executed as part of performance* OpenShift CI jobs ([rhd-sbo] Add periodic (weekly) jobs to run performance tests openshift/release#33192) (after the test-performance-collect-kpi step) and fails the job if any of the thresholds is crossed.

Submitter Checklist

As the author of this PR, please check off the items in this checklist:

• Docs
  included if any changes are user facing
• Tests
  included if any functionality added or changed. For bugfixes please include tests that can catch regressions
• All acceptance test scenarios included in the PR which verifies a bugfix or a requested feature reported by a non-member are tagged with @external-feedback tag.
• Follows the commit message standard

[openshift-ci]

Skipping CI for Draft Pull Request.
If you want CI signal for your change, please convert it to an actual PR.
You can still manually trigger a test run with /test all

[codecov]

Codecov Report

Merging #1271 (42a7ae1) into master (6cdb804) will not change coverage.
The diff coverage is n/a.

❗ Current head 42a7ae1 differs from pull request most recent head e7dfbdd. Consider uploading reports for the commit e7dfbdd to get more accurate results

Additional details and impacted files

@@           Coverage Diff           @@
##           master    #1271   +/-   ##
=======================================
  Coverage   58.06%   58.06%           
=======================================
  Files          33       33           
  Lines        2797     2797           
=======================================
  Hits         1624     1624           
  Misses       1018     1018           
  Partials      155      155           

---

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 6cdb804...e7dfbdd. Read the comment docs.

[pmacik]

/test 4.10-performance-reduced
/test 4.11-performance-reduced
/test performance

[pmacik]

/test 4.10-performance-reduced
/test 4.11-performance-reduced
/test performance

[pmacik]

/test 4.10-performance-reduced
/test 4.11-performance-reduced
/test performance

[baijum]

/lgtm

[dperaza4dustbit]

/lgtm

[openshift-ci]

[APPROVALNOTIFIER] This PR is APPROVED

Approval requirements bypassed by manually added approval.

This pull-request has been approved by:

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Needs approval from an approver in each of these files:

• OWNERS

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

[pmacik]

/retest