Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Gen2: Add spatial detection network and spatial location calculator #83

Merged
merged 34 commits into from
Mar 16, 2021

Conversation

SzabolcsGergely
Copy link
Collaborator

@SzabolcsGergely SzabolcsGergely commented Mar 10, 2021

  • Added spatial detection network node == DetectionNetwork + xyz spatial data.
  • Added spatial location node == retrieves average depth + xyz spatial data on a set of predefined ROIs mapped to depth frame.

Added 3 examples:

  • spatial_mobilenet - runs mobilenet ssd on RGB camera and retrieves XYZ data.

  • spatial_mobilenet_mono - runs mobilenet ssd on rectified right camera (perfectly matches depth frame) and retrieves XYZ data.

  • spatial_location_calculator - calculates average depth + XYZ on a predefined ROI, controllable w/ WASD keys.

  • Fixed stereo example, rectified frame was flipped.

FW public changelog:

  • Fixed logger in resource allocator, the log didn't reach the host on error.

  • Fixed uninitialized values in ImageManip, the parent frame metadata wasn't copied (timestamp etc.)

  • Added logger in stereo node, it reports back the configured settings and calibration info, together w/ homography

  • Changed all stereo depth output format to U16

  • Fixed issues in stereo node regarding to ImageFrames, instance number was not set properly.

  • Undefined/invalid depth set to 0 instead of infinity (65535 mm)

  • Fixed X,Y,Z coordinates, Z axis was wrongly decomposed on gen1.

Displayed depth frame now goes through MIN_MAX normalization + histogram equalization + colorization. Better for visualization.

The documentation will cover the API.

@Luxonis-Brandon
Copy link
Contributor

AWESOME! Very excited about this!

@Luxonis-Brandon Luxonis-Brandon added the Gen2 Feature for or issue with Gen2 label Mar 10, 2021
@Luxonis-Brandon Luxonis-Brandon added this to In progress in Gen2 Phase I Delivery via automation Mar 10, 2021
examples/src/spatial_location_calculator_example.cpp Outdated Show resolved Hide resolved
examples/src/spatial_mobilenet_example.cpp Outdated Show resolved Hide resolved
examples/src/spatial_mobilenet_mono_example.cpp Outdated Show resolved Hide resolved
examples/src/spatial_mobilenet_mono_example.cpp Outdated Show resolved Hide resolved
include/depthai/pipeline/node/SpatialDetectionNetwork.hpp Outdated Show resolved Hide resolved
examples/src/stereo_example.cpp Outdated Show resolved Hide resolved
examples/src/stereo_example.cpp Outdated Show resolved Hide resolved
@SzabolcsGergely SzabolcsGergely merged commit 1b53615 into develop Mar 16, 2021
@SzabolcsGergely SzabolcsGergely deleted the gen2_spatial_detection_network branch March 16, 2021 13:34
@Luxonis-Brandon Luxonis-Brandon moved this from In progress to Done in Gen2 Phase I Delivery Mar 16, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Gen2 Feature for or issue with Gen2
Development

Successfully merging this pull request may close these issues.

None yet

4 participants