Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We鈥檒l occasionally send you account related emails.

Already on GitHub? Sign in to your account

Fix DepthGaussianNoise test #271

Merged
merged 2 commits into from
Mar 16, 2021
Merged

Fix DepthGaussianNoise test #271

merged 2 commits into from
Mar 16, 2021

Conversation

iche033
Copy link
Contributor

@iche033 iche033 commented Mar 13, 2021

Signed-off-by: Ian Chen ichen@osrfoundation.org

馃 Bug fix

Fixes one of the test Gaussian noise test failures mentioned in #175

Summary

While the difference between data with noise and data without noise should be within 3 sigma, the difference between 2 noisy values should be within 2 * 3 sigma, i.e. full span of the Gaussian noise distribution

Checklist

  • Signed all commits for DCO
  • Added tests
  • Updated documentation (as needed)
  • Updated migration guide (as needed)
  • codecheck passed (See contributing)
  • All tests passed (See test coverage)
  • While waiting for a review on your PR, please help review another open pull request to support the maintainers

Note to maintainers: Remember to use Squash-Merge

Signed-off-by: Ian Chen <ichen@osrfoundation.org>
@github-actions github-actions bot added the 馃彴 citadel Ignition Citadel label Mar 13, 2021
@osrf-triage osrf-triage added this to Inbox in Core development Mar 13, 2021
@iche033 iche033 mentioned this pull request Mar 13, 2021
@codecov
Copy link

codecov bot commented Mar 13, 2021

Codecov Report

Merging #271 (897f311) into ign-rendering3 (93539bd) will decrease coverage by 0.00%.
The diff coverage is n/a.

Impacted file tree graph

@@                Coverage Diff                 @@
##           ign-rendering3     #271      +/-   ##
==================================================
- Coverage           50.59%   50.58%   -0.01%     
==================================================
  Files                 129      129              
  Lines               11887    11887              
==================================================
- Hits                 6014     6013       -1     
- Misses               5873     5874       +1     
Impacted Files Coverage 螖
...e/ignition/rendering/base/BaseGaussianNoisePass.hh 96.66% <0.00%> (-3.34%) 猬囷笍

Continue to review full report at Codecov.

Legend - Click here to learn more
螖 = absolute <relative> (impact), 酶 = not affected, ? = missing data
Powered by Codecov. Last update 93539bd...897f311. Read the comment docs.

@adlarkin adlarkin self-requested a review March 15, 2021 13:40
Copy link
Contributor

@adlarkin adlarkin left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

All tests passed, except for Focal on GitHub actions:

/github/workspace/test/integration/render_pass.cc:321: Failure
  The difference between expectedRangeAtMidPoint + noiseMean and mx is 0.032002305984496937, which exceeds noiseTol, where
  expectedRangeAtMidPoint + noiseMean evaluates to 1.4000000000000001,
  mx evaluates to 1.4320023059844971, and
  noiseTol evaluates to 0.029999999329447746.
  [  FAILED  ] GaussianNoise/RenderPassTest.DepthGaussianNoise/ogre2, where GetParam() = "ogre2" (282 ms)

It looks like decreasing noiseTol to 3 * sigma (was originally 4 * sigma) results in a tolerance that is too tight for this check: https://github.com/ignitionrobotics/ign-rendering/blob/695fbd65c397ba6f9eedda03bc51379f506e7e5d/test/integration/render_pass.cc#L321

@chapulina chapulina moved this from Inbox to In review in Core development Mar 15, 2021
Signed-off-by: Ian Chen <ichen@osrfoundation.org>
@iche033
Copy link
Contributor Author

iche033 commented Mar 16, 2021

relaxed tolerance in 897f311, will see if this will make CI happy

@adlarkin adlarkin self-requested a review March 16, 2021 14:42
@adlarkin
Copy link
Contributor

will see if this will make CI happy

Windows came back red, but I believe that this is due to an issue with one of the Windows CI machines. I have re-triggered windows CI... just waiting in the queue for a spot to open (job 1424 in the queue): https://build.osrfoundation.org/job/ign_rendering-pr-win/

Copy link
Contributor

@adlarkin adlarkin left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Windows is green now 馃榿

@chapulina chapulina merged commit e3d56ad into ign-rendering3 Mar 16, 2021
Core development automation moved this from In review to Done Mar 16, 2021
@chapulina chapulina deleted the fix_gauss_test branch March 16, 2021 17:23
chapulina added a commit that referenced this pull request Mar 17, 2021
* Master branch updates (#268)

Signed-off-by: Louise Poubel <louise@openrobotics.org>

* Fix DepthGaussianNoise test (#271)

Signed-off-by: Ian Chen <ichen@osrfoundation.org>

Co-authored-by: Ian Chen <ichen@osrfoundation.org>
@j-rivero j-rivero removed this from Done in Core development May 6, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
馃彴 citadel Ignition Citadel
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

3 participants