Skip to content

IR Illumination + IR-Capable Grayscale Stereo Pair #22

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
Luxonis-Brandon opened this issue Oct 7, 2020 · 3 comments
Closed

IR Illumination + IR-Capable Grayscale Stereo Pair #22

Luxonis-Brandon opened this issue Oct 7, 2020 · 3 comments
Labels
enhancement New feature or request

Comments

@Luxonis-Brandon
Copy link
Contributor

Start with the why:

While adding pattern projectors like in #20 affords disparity depth to work in absence of any ambient lighting, neural inference likely will not (as there will be little dots of illumination, not overall illumination).

So to allow 3D object localization (i.e. an object detector like YOLO or MobileNet-SSD fused with spatial information), having overall illumination (and not just pattern projection) is required.

Move to the how:

So there are 3 options for supporting the IR-capable camera modules:

  1. Use IR-only camera modules (i.e. bandpass around IR).
  2. Use Visible-light + IR-light capable camera modules (i.e. a single bandpass covering all visible + IR spectra)
  3. Use a mechanical IR-cut filter that engages during high ambient light and disengages during low-light conditions when the IR illuminators are active.

We have tested both 1 and 2 with DepthAI (example images below) and found that 1 produces much sharper images when IR illumination is being used (this IR flashlight was used). See the quick test results below:

  1. Examples image or IR-bandpass-only camera modules with IR-flashlight below:
    image
  2. Example of Visible-light + IR-light capable camera modules with IR-flashlight below:
    image

We have not yet tested option 3, but it could be an interesting solution - but with the cost that usually such mechanical moving parts are a point of failure.

Move to the what:

Support IR illumination for object detection and disparity depth in total (ambient) darkness conditions.

@Luxonis-Brandon
Copy link
Contributor Author

As an update ArduCam has produced an IR-capable, electrically and mechanically and optically equivalent OV9282 module for this:
image

@Luxonis-Brandon
Copy link
Contributor Author

As an update, these are now available on ArduCam's website:

  1. https://www.arducam.com/product/arducam-1mp-ov9282-ccm-drop-in-replacement-for-oak-d/
  2. https://www.arducam.com/product/arducam-1mp-ov9282-global-shutter-mono-mipi-camera-module-20pin-for-depthai/

Please not that 1 above can be used directly on our designs, but keep in mind that the existing modules that come pre-mounted on our boards are actually glued down. So these are recommended for new designs, or fresh DepthAI boards for which cameras have not yet been installed. Otherwise, if you are trying to replace cameras on a DepthAI board with cameras already mounted, you'd have to do some surgery with isopropyl alcohol and a xacto-knife to catastrophically-remove the existing camera module (which might be a terrible idea).

And 2 is recommended for prototyping. It can be used with the BW1098FFC or the DM090FFC (here). It also has M12 lens mounting, so it allows swapping in a variety of lenses for a variety of filtering, field of view, etc. permutations.

And these

@Luxonis-Brandon
Copy link
Contributor Author

This is now implemented in #114

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

1 participant