Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Ensure a plugin isn't reported as passed if no results were read #841

Merged
merged 1 commit into from Aug 15, 2019
Merged

Ensure a plugin isn't reported as passed if no results were read #841

merged 1 commit into from Aug 15, 2019

Conversation

johnSchnake
Copy link
Contributor

What this PR does / why we need it:
In the case where the e2e plugin reported results (a tarball) but
it did not contain an xml file of junit results we want to be sure
to NOT count this as a success.

It may be reasonable to consider this a failure but I think it is
more generic/safe to just report it as unknown and users can
handle that case differently.

Also, I found another bug which was causing daemonsets to not
properly be bubbling up their results.

Which issue(s) this PR fixes
Fixes #840

Special notes for your reviewer:

Release note:

Fixes a bug which caused `sonobuoy results` to report success if no results were processed at all. Modified this case to return 'unknown' instead.

In the case where the e2e plugin reported results (a tarball) but
it did not contain an xml file of junit results we want to be sure
to NOT count this as a success.

It may be reasonble to consider this a failure but I think it is
more generic/safe to just report it as unknown and users can
handle that case differently.

Also, I found another bug which was causing daemonsets to not
properly be bubbling up their results.

Fixes #840

Signed-off-by: John Schnake <jschnake@vmware.com>
@codecov-io
Copy link

Codecov Report

Merging #841 into master will increase coverage by 0.08%.
The diff coverage is 100%.

Impacted file tree graph

@@            Coverage Diff             @@
##           master     #841      +/-   ##
==========================================
+ Coverage   46.19%   46.28%   +0.08%     
==========================================
  Files          75       75              
  Lines        4788     4790       +2     
==========================================
+ Hits         2212     2217       +5     
+ Misses       2446     2445       -1     
+ Partials      130      128       -2
Impacted Files Coverage Δ
pkg/client/results/processing.go 81.81% <100%> (+0.48%) ⬆️
cmd/sonobuoy/app/status.go 57.54% <0%> (-1.89%) ⬇️
pkg/plugin/aggregation/aggregator.go 83.2% <0%> (+4%) ⬆️

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 0fb9865...61fe463. Read the comment docs.

@johnSchnake johnSchnake merged commit c7d0673 into vmware-tanzu:master Aug 15, 2019
@johnSchnake johnSchnake deleted the failIfNoJunit branch August 15, 2019 20:02
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

New postprocessing step passes when test results are missing
3 participants