Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Updating compliance tests to use prune-unused OPA compiler flag #111

Draft
wants to merge 1 commit into
base: main
Choose a base branch
from

Conversation

johanfylling
Copy link
Collaborator

WIP: Need to figure out if use of this flag has negative impact on test coverage

Partially fixes #110

Signed-off-by: Johan Fylling johan.dev@fylling.se

@anderseknert
Copy link
Collaborator

Huh, yeah definitely looks like something like that is going on. Would have expected ~70 tests to be added, but the diff is only +9 from before 🤔 We could of course just compile with the prune flag where the plan otherwise comes back as nil, or is there some smarter solution, you reckon?

main
Ran 1140 tests containing 1140 assertions.
0 failures, 0 errors.

test/compliance
Ran 1149 tests containing 1149 assertions.
3 failures, 2 errors.

@johanfylling
Copy link
Collaborator Author

Forgot to mention 😄 : the 62 missing tests are because of eval failures when running OPA to generate the baseline. Will look into those separately.

@anderseknert
Copy link
Collaborator

Ah, interesting! Do let me know what you find 🤓

@anderseknert anderseknert added this to To do in Jarl Development Oct 27, 2022
Signed-off-by: Johan Fylling <johan.dev@fylling.se>
@johanfylling
Copy link
Collaborator Author

Lots of failing tests to figure out 😅 .

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
Development

Successfully merging this pull request may close these issues.

72 tests ignored due to missing plan
2 participants