Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Run NN on left/right mono cameras #94

Merged
merged 51 commits into from Jul 20, 2020
Merged

Run NN on left/right mono cameras #94

merged 51 commits into from Jul 20, 2020

Commits on May 6, 2020

  1. Add option to select the camera {rgb,left,right} used for NN 

    Rebuild libs, TODO RPi
    @alex-luxonis
    alex-luxonis committed May 6, 2020
    Copy the full SHA
    8b2674f View commit details
    Browse the repository at this point in the history

Commits on May 15, 2020

  1. Update device FW

    @alex-luxonis
    alex-luxonis committed May 15, 2020
    Copy the full SHA
    c779688 View commit details
    Browse the repository at this point in the history

Commits on May 26, 2020

  1. Add support for NN on both Left+Right

    @alex-luxonis
    alex-luxonis committed May 26, 2020
    Copy the full SHA
    0abf7b4 View commit details
    Browse the repository at this point in the history

  2. Update firmware(USB3) and x86_64 lib

    @alex-luxonis
    alex-luxonis committed May 26, 2020
    Copy the full SHA
    a0ce026 View commit details
    Browse the repository at this point in the history

Commits on May 28, 2020

  1. Merge remote-tracking branch 'origin/master' into nn_on_left_right

    @alex-luxonis
    alex-luxonis committed May 28, 2020
    Copy the full SHA
    588815e View commit details
    Browse the repository at this point in the history

  2. Rebuild FW(USB3) and x86_64 lib after merge w/ master

    @alex-luxonis
    alex-luxonis committed May 28, 2020
    Copy the full SHA
    1a90a15 View commit details
    Browse the repository at this point in the history

Commits on May 29, 2020

  1. mobilenet_ssd: check confidence_threshold and append to list when dec… 

    …oding,

not when displaying (for a slight improvement in performance)
    @alex-luxonis
    alex-luxonis committed May 29, 2020
    Copy the full SHA
    3014ada View commit details
    Browse the repository at this point in the history

  2. TMP workaround: create a copy of NN data, due to issues with C++/pyth… 

    …on bindings,

previously there were crashes and wrong BB association to previewout frames,
with the option `-cam left_right`
    @alex-luxonis
    alex-luxonis committed May 29, 2020
    Copy the full SHA
    c0113f0 View commit details
    Browse the repository at this point in the history

  3. Update FW, fix crash with -dd/--disable_depth

    @alex-luxonis
    alex-luxonis committed May 29, 2020
    Copy the full SHA
    9fc89a9 View commit details
    Browse the repository at this point in the history

Commits on Jun 11, 2020

  1. Two-stage inference: pass a second NN model with -cnn2

    @alex-luxonis
    alex-luxonis committed Jun 11, 2020
    Copy the full SHA
    5801d3c View commit details
    Browse the repository at this point in the history

  2. TMP merge landmarks-regression-retail-0009.json into 

    face-detection-retail-0004.json
    @alex-luxonis
    alex-luxonis committed Jun 11, 2020
    Copy the full SHA
    820b368 View commit details
    Browse the repository at this point in the history

  3. Rebuild USB3 FW and Linux x86_64 lib

    @alex-luxonis
    alex-luxonis committed Jun 11, 2020
    Copy the full SHA
    3f22f02 View commit details
    Browse the repository at this point in the history

  4. Draw the face landmarks, works with the patched JSON

    @alex-luxonis
    alex-luxonis committed Jun 11, 2020
    Copy the full SHA
    16289cb View commit details
    Browse the repository at this point in the history

Commits on Jun 15, 2020

  1. Compiled for 10 Shaves: face-detection-retail-0004, landmarks-regress… 

    …ion-retail-0009
    @alex-luxonis
    alex-luxonis committed Jun 15, 2020
    Copy the full SHA
    a119259 View commit details
    Browse the repository at this point in the history

  2. TMP update FW: run on 10 shaves, disable RGB and Depth

    @alex-luxonis
    alex-luxonis committed Jun 15, 2020
    Copy the full SHA
    3544784 View commit details
    Browse the repository at this point in the history

Commits on Jun 16, 2020

  1. Compiled for 6 Shaves: face-detection-retail-0004, landmarks-regressi… 

    …on-retail-0009,

To be used with two executors: 12 Shaves and 2 NCEs in total.
    @alex-luxonis
    alex-luxonis committed Jun 16, 2020
    Copy the full SHA
    7e84f8f View commit details
    Browse the repository at this point in the history

  2. Rebuild FW and linux lib: running NN on 2 executors/threads: 

    1 NCE + 6 Shaves each
    @alex-luxonis
    alex-luxonis committed Jun 16, 2020
    Copy the full SHA
    6d176d8 View commit details
    Browse the repository at this point in the history

Commits on Jun 19, 2020

  1. add support of emotion-recognition-retail-0003 as second-stage 

    (commit amended to revert unintended add of depthai.cpython-37m-darwin.so)
    @Luxonis-Steven @alex-luxonis
    Luxonis-Steven authored and alex-luxonis committed Jun 19, 2020
    Copy the full SHA
    b647532 View commit details
    Browse the repository at this point in the history

Commits on Jun 22, 2020

  1. Configurable FPS and resolution for Mono cameras: 

    - up to 60fps, but should be lowered when running slower network models (on both L+R)
- 1280x720 or 640x400 (binning enabled) resolution
    @alex-luxonis
    alex-luxonis committed Jun 22, 2020
    Copy the full SHA
    d8e7e62 View commit details
    Browse the repository at this point in the history

Commits on Jun 30, 2020

  1. Support for mono resolutions: 1280x720, 1280x800, 640x400

    @alex-luxonis
    alex-luxonis committed Jun 30, 2020
    Copy the full SHA
    92f8cef View commit details
    Browse the repository at this point in the history

  2. Add checks for NN camera input, for 'draw_bb_depth'

    @alex-luxonis
    alex-luxonis committed Jun 30, 2020
    Copy the full SHA
    a2d9ce0 View commit details
    Browse the repository at this point in the history

  3. TMP face-detection-retail-0004_depth: add 2nd stage tensor description

    @alex-luxonis
    alex-luxonis committed Jun 30, 2020
    Copy the full SHA
    066e47e View commit details
    Browse the repository at this point in the history

  4. Rebuild USB3 FW and Linux x86_64 lib

    @alex-luxonis
    alex-luxonis committed Jun 30, 2020
    Copy the full SHA
    e202934 View commit details
    Browse the repository at this point in the history

Commits on Jul 2, 2020

  1. Parsing for both JSONs fixed, patching no longer needed. 

    Revert changes to json files, remove face-detection-retail-emotion-0004
    @alex-luxonis
    alex-luxonis committed Jul 2, 2020
    Copy the full SHA
    31b21e5 View commit details
    Browse the repository at this point in the history

  2. Rebuild USB3 FW and Linux x86_64 lib

    @alex-luxonis
    alex-luxonis committed Jul 2, 2020
    Copy the full SHA
    ac606f8 View commit details
    Browse the repository at this point in the history

  3. Merge remote-tracking branch 'origin/master' into nn_on_left_right

    @alex-luxonis
    alex-luxonis committed Jul 2, 2020
    Copy the full SHA
    c0bc492 View commit details
    Browse the repository at this point in the history

  4. Rebuild FW and Linux x86_64 lib

    @alex-luxonis
    alex-luxonis committed Jul 2, 2020
    Copy the full SHA
    593b728 View commit details
    Browse the repository at this point in the history

  5. depthai.py cleanup: remove temporary limitation for 1st stage 

    (face-detection-retail-0004)
    @alex-luxonis
    alex-luxonis committed Jul 2, 2020
    Copy the full SHA
    fa75cb0 View commit details
    Browse the repository at this point in the history

  6. depthai.py cleanup: -remove output tensor copy, 

    as the lost-reference bug was fixed;
- move 2nd stage decoding to show_mobilenet_ssd
    @alex-luxonis
    alex-luxonis committed Jul 2, 2020
    Copy the full SHA
    0486caf View commit details
    Browse the repository at this point in the history

Commits on Jul 5, 2020

  1. Merge remote-tracking branch 'origin/master' into nn_on_left_right

    @alex-luxonis
    alex-luxonis committed Jul 5, 2020
    Copy the full SHA
    d0dd1aa View commit details
    Browse the repository at this point in the history

  2. Merge remote-tracking branch 'origin/master' into nn_on_left_right

    @alex-luxonis
    alex-luxonis committed Jul 5, 2020
    Copy the full SHA
    7f70d86 View commit details
    Browse the repository at this point in the history

Commits on Jul 6, 2020

  1. Re-apply second-stage NN decode and show

    @alex-luxonis
    alex-luxonis committed Jul 6, 2020
    Copy the full SHA
    4f54a1a View commit details
    Browse the repository at this point in the history

  2. For two-stage NN, recompile second-model too (shv,cmx,nce)

    @alex-luxonis
    alex-luxonis committed Jul 6, 2020
    Copy the full SHA
    3543a44 View commit details
    Browse the repository at this point in the history

  3. Add **kwargs to all other decode_NN functions 

    (even if unused for now, used only with decode_mobilenet_ssd)
    @alex-luxonis
    alex-luxonis committed Jul 6, 2020
    Copy the full SHA
    d448f5a View commit details
    Browse the repository at this point in the history

  4. Rebuild FW and Linux x86_64 lib, update depthai-api

    @alex-luxonis
    alex-luxonis committed Jul 6, 2020
    Copy the full SHA
    e50c12e View commit details
    Browse the repository at this point in the history

  5. Update mono cam resolution and FPS support: 

    up to 60fps for H:720 or H:800, up to 120fps for H:400.
    @alex-luxonis
    alex-luxonis committed Jul 6, 2020
    Copy the full SHA
    c508862 View commit details
    Browse the repository at this point in the history

  6. Count NN FPS per camera source, display in previewout bottom-left

    @alex-luxonis
    alex-luxonis committed Jul 6, 2020
    Copy the full SHA
    7606e42 View commit details
    Browse the repository at this point in the history

  7. Display BBox over left/right when cnn_camera == 'rgb'

    @alex-luxonis
    alex-luxonis committed Jul 6, 2020
    Copy the full SHA
    f0b6ab3 View commit details
    Browse the repository at this point in the history

  8. Update FW: fix for non-mobilenetssd single-stage

    @alex-luxonis
    alex-luxonis committed Jul 6, 2020
    Copy the full SHA
    0d1a5f0 View commit details
    Browse the repository at this point in the history

  9. Implement configurable FPS for RGB: 

    max 42 fps for 4K, max 118 fps 1080p.
Higher is possible by tweaking the configs.
    @alex-luxonis
    alex-luxonis committed Jul 6, 2020
    Copy the full SHA
    f961183 View commit details
    Browse the repository at this point in the history

Commits on Jul 7, 2020

  1. Update depthai-api: fix a clang compilation error on macOS

    @alex-luxonis
    alex-luxonis committed Jul 7, 2020
    Copy the full SHA
    f6f0008 View commit details
    Browse the repository at this point in the history

Commits on Jul 9, 2020

  1. merge master into nn_on_left_right

    @SzabolcsGergely
    SzabolcsGergely committed Jul 9, 2020
    Copy the full SHA
    db0d900 View commit details
    Browse the repository at this point in the history

  2. Merge remote-tracking branch 'origin/master' into nn_on_left_right_merge

    @SzabolcsGergely
    SzabolcsGergely committed Jul 9, 2020
    Copy the full SHA
    38dfce2 View commit details
    Browse the repository at this point in the history

  3. synchronize NN packets with latest depth packets

    @SzabolcsGergely
    SzabolcsGergely committed Jul 9, 2020
    Copy the full SHA
    92f6064 View commit details
    Browse the repository at this point in the history

  4. fix 12mp full resolution

    @SzabolcsGergely
    SzabolcsGergely committed Jul 9, 2020
    Copy the full SHA
    7f9a1b9 View commit details
    Browse the repository at this point in the history

  5. free up another shave for NN; max shaves : 14/1080p, 11/4k

    @SzabolcsGergely
    SzabolcsGergely committed Jul 9, 2020
    Copy the full SHA
    235802d View commit details
    Browse the repository at this point in the history

Commits on Jul 17, 2020

  1. Merge pull request #152 from luxonis/14shave_nn 

    Free up another shave for NN; max shaves : 14/1080p, 11/4k
    @SzabolcsGergely
    SzabolcsGergely committed Jul 17, 2020
    Copy the full SHA
    77928f3 View commit details
    Browse the repository at this point in the history

Commits on Jul 20, 2020

  1. recompile lib for x86_64-linux

    @SzabolcsGergely
    SzabolcsGergely committed Jul 20, 2020
    Copy the full SHA
    d53f034 View commit details
    Browse the repository at this point in the history

  2. rebuild RPI lib

    @SzabolcsGergely
    SzabolcsGergely committed Jul 20, 2020
    Copy the full SHA
    07e74c7 View commit details
    Browse the repository at this point in the history

  3. Merge remote-tracking branch 'origin/master' into HEAD

    @SzabolcsGergely
    SzabolcsGergely committed Jul 20, 2020
    Copy the full SHA
    28c8a6b View commit details
    Browse the repository at this point in the history

  4. Force default NN engines to 2 in case inference is done on 2 cameras

    @SzabolcsGergely
    SzabolcsGergely committed Jul 20, 2020
    Copy the full SHA
    84aa59c View commit details
    Browse the repository at this point in the history