Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Rgb noise models #357

Merged
merged 56 commits into from
Dec 28, 2019
Merged

Conversation

NicoGrande
Copy link
Contributor

@NicoGrande NicoGrande commented Nov 18, 2019

Motivation and Context

This change builds upon the redwood depth noise model implemented by Erik Wijmans with the objective of implementing color noise models in Habitat. This change includes initial commits for four new RGB noise models, namely Gaussian noise, Speckle noise, Salt and Pepper noise and Poisson noise. The hope for this pull request is to continue the efforts to allow for embodied agents to train under realistic sensor noise to further understand their behavior in sub-optimal sensor conditions.

Noise models RGB output with default parameters (added by @mathfac)
Gaussian Noise Model:
image

Poisson Noise Model:
image

Speckle Noise Model:
image

SaltAndPepper Noise Model:
image

How Has This Been Tested

These modification have been tested to gauge the frame rate at which the noise models are applied to arbitrary NumPy arrays as well as tested to see the visual effect of the noise models in the simulation environment. These tests can be replicated using sensor_test.py and viewer.py respectively.

Types of changes

  • Docs change / refactoring / dependency upgrade
  • Bug fix (non-breaking change which fixes an issue)
  • New feature (non-breaking change which adds functionality)
  • Breaking change (fix or feature that would cause existing functionality to change)

Checklist

  • My code follows the code style of this project.
  • My change requires a change to the documentation.
  • I have updated the documentation accordingly.
  • I have read the CONTRIBUTING document.
  • I have completed my CLA (see CONTRIBUTING)
  • I have added tests to cover my changes.
  • All new and existing tests passed.

@@ -0,0 +1,72 @@
import abc
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I believe this file can be removed

viewer.py Outdated
@@ -0,0 +1,87 @@
import cv2
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Please remove this file from the PR

sensor_test.py Outdated
@@ -0,0 +1,61 @@
import timeit
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Same with this file

Copy link
Contributor

@erikwijmans erikwijmans left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Copy link
Contributor

@erikwijmans erikwijmans left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@erikwijmans erikwijmans merged commit 43f9755 into facebookresearch:master Dec 28, 2019
@mathfac
Copy link
Contributor

mathfac commented Feb 18, 2020

Added noise models RGB outputs with default parameters to make noise mode choice easier.

eundersander pushed a commit to eundersander/habitat-sim that referenced this pull request Aug 6, 2020
Ram81 pushed a commit to Ram81/habitat-web-sim that referenced this pull request Dec 10, 2020
Addition of Gaussian noise, Speckle noise, Salt and Pepper noise and Poisson noise for RGB sensors.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
CLA Signed Do not delete this pull request or issue due to inactivity.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

4 participants