fix: ssg_test_suite: warning when rule not in benchmark

[maage]

Description:

When rule selected to be tested is not in benchmark, issue WARNING, not ERROR.

Rationale:

ERROR message just confuses most of time and the situation is not something that can be fixed. It is lack of configuration. I think warning is better choice.

In many cases Automatus tests fail because it checks ERROR string in log.

For example now: #10600 there is the case.

Review Hints:

I'm not sure if this is the way to fix the issue. Maybe testing rule selection algorithm should not not select rules not in benchmarks. Warnings are still visible in logs.

[openshift-ci]

Hi @maage. Thanks for your PR.

I'm waiting for a ComplianceAsCode member to verify that this patch is reasonable to test. If it is, they should reply with /ok-to-test on its own line. Until that is done, I will not automatically test new commits in this PR, but the usual testing commands by org members will still work. Regular contributors should join the org to skip this step.

Once the patch is verified, the new status will be reflected by the ok-to-test label.

I understand the commands that are listed here.

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.

[github-actions]

Start a new ephemeral environment with changes proposed in this pull request:

Fedora Environment

Oracle Linux 8 Environment

[codeclimate]

Code Climate has analyzed commit 8440a09 and detected 0 issues on this pull request.

The test coverage on the diff in this pull request is 100.0% (50% is the threshold).

This pull request will bring the total coverage in the repository to 52.5% (0.0% change).

View more on Code Climate.

[vojtapolasek]

/ok-to-test

[vojtapolasek]

Thank you @maage, this looks reasonable. I think it will make the upstream PR reviewing process easier.

[maage]

Thanks