Add documentation to known issue in the test suite. #4730
Merged
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
jan-cerny
reviewed
Aug 15, 2019
tests/README.md
Outdated
| Rule <rule_id> has not been evaluated! Wrong profile selected in test scenario? | ||
| ``` | ||
|
|
||
| If you are using SCAP 1.3 content (which is built by default) and you are sure that you have selected the rule in the particular profile, it might be that the target scan environment has OpenSCAP version prior to 1.3.1. To solve this issue you can either update the OpenSCAP package in the target scan environment or build SCAP 1.2 content. To build SCAP 1.2 content check the [SSG Developer Guide](../docs/manual/developer_guide.adoc) |
There was a problem hiding this comment.
I think it isn't fully correct because OpenSCAP in Red Hat Enterprise Linux 7.7 and newer can process SCAP 1.3 content even if there is openscap-1.2.? Could you take a look?
There was a problem hiding this comment.
I've updated the doc text, can you please take a look?
When using test suite with SCAP 1.3 and OpenSCAP with version which contains the fetch-remote-resources bug, an er=ror will be thrown saying that a rule is probably not selected in a profile. This documentation explains how to solve the issue.
ggbecker
force-pushed
the
document-test-suite-with-scap12
branch
from
2d0dc13
to
fe4e15e
Compare
yuumasato
reviewed
Aug 15, 2019
| 1 - Test suite fails to test rule with the message: | ||
|
|
||
| ``` | ||
| Rule <rule_id> has not been evaluated! Wrong profile selected in test scenario? |
There was a problem hiding this comment.
Would it be possible to improve error message?
There was a problem hiding this comment.
I think it is. It would have to parse the oscap output and identify the error, but I think it is not a trivial change.
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Description:
When using test suite with SCAP 1.3 and OpenSCAP with version which
contains the fetch-remote-resources bug, an er=ror will be thrown saying that a rule is probably not
selected in a profile. This documentation explains how to solve the issue.
Fixes tests/test_suite.py rule fails with Rule xccdf_org.ssgproject.content_rule_coredump_disable_backtraces has not been evaluated! Wrong profile selected in test scenario? #4703