Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Better pose filtering by confidences #1094

Merged
merged 21 commits into from
Jul 10, 2024

Conversation

ThagonDuarte
Copy link
Contributor

@ThagonDuarte ThagonDuarte commented Jul 3, 2024

Why? What?

A lot of the false positives that cause Motion in Standby, happen when people (or naos) are only partially present in the image. This PR uses the confidence values the yolo network provides for every keypoint, in addition to the bounding box confidences, to filter out those poses. Three confidence thresholds now provide granular control over the filtering.

Implements #985

ToDo / Known Issues

Ideas for Next Iterations (Not This PR)

How to Test

  • Setup a visual referee scenario
  • Choose whether filtered or unfiltered poses are painted in the overlay selector
  • Change the confidence threshold parameters in pose_detection

@ThagonDuarte ThagonDuarte marked this pull request as ready for review July 3, 2024 14:06
@ThagonDuarte ThagonDuarte force-pushed the filter_poses_more_strictly branch 2 times, most recently from a526fd5 to 9c3f3d0 Compare July 4, 2024 15:51
crates/types/src/pose_detection.rs Show resolved Hide resolved
crates/types/src/pose_detection.rs Outdated Show resolved Hide resolved
crates/object_detection/src/pose_detection.rs Outdated Show resolved Hide resolved
tools/twix/src/panels/image/overlays/pose_detection.rs Outdated Show resolved Hide resolved
tools/twix/src/panels/image/overlays/pose_detection.rs Outdated Show resolved Hide resolved
crates/object_detection/src/pose_interpretation.rs Outdated Show resolved Hide resolved
crates/object_detection/src/pose_interpretation.rs Outdated Show resolved Hide resolved
etc/parameters/default.json Outdated Show resolved Hide resolved
crates/object_detection/src/pose_detection.rs Show resolved Hide resolved
tools/twix/src/panels/image/overlays/pose_detection.rs Outdated Show resolved Hide resolved
@ThagonDuarte ThagonDuarte force-pushed the filter_poses_more_strictly branch 3 times, most recently from 71b62dc to 8fc671f Compare July 7, 2024 18:06
etc/parameters/framework.json Outdated Show resolved Hide resolved
crates/object_detection/src/pose_interpretation.rs Outdated Show resolved Hide resolved
@ThagonDuarte ThagonDuarte force-pushed the filter_poses_more_strictly branch 2 times, most recently from d1c5bb0 to 6857f1d Compare July 10, 2024 13:05
ThagonDuarte and others added 7 commits July 10, 2024 15:05
Co-authored-by: ole.flb <45100017+oleflb@users.noreply.github.com>
Co-authored-by: knoellle <33729490+knoellle@users.noreply.github.com>
…anel

Co-authored-by: ole.flb <45100017+oleflb@users.noreply.github.com>
Copy link
Contributor

@knoellle knoellle left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks good to referee

@ThagonDuarte ThagonDuarte added this pull request to the merge queue Jul 10, 2024
Merged via the queue into HULKs:main with commit 2ba26be Jul 10, 2024
25 checks passed
@ThagonDuarte ThagonDuarte deleted the filter_poses_more_strictly branch July 10, 2024 13:29
oleflb added a commit to oleflb/hulk that referenced this pull request Jul 15, 2024
* Renaming thresholds

* Filter poses by keypoint confidences

* Renaming

* Draw bounding box of pose

* Seperate confidence filters for important and other keypoints

* Add pose filter, seperate filtered and unfiltered poses

* Rename object_detection parameters object to pose_detection

* Fix pose subscription path

* Add switch between unfiltered and filtered pose painting

Format

* Add pose detection dead zone indicator

* Increase `pose_detection.bounding_box_confidence_threshold`

* Bump twix

* Split uses correctly

* Split uses here correctly as well

* Fix rebase error

* Address review comments die Erste

* Address review comments die Zweite

Co-authored-by: ole.flb <45100017+oleflb@users.noreply.github.com>
Co-authored-by: knoellle <33729490+knoellle@users.noreply.github.com>

* Draw accepted, rejected and referee pose kind positions in twix map panel

Co-authored-by: ole.flb <45100017+oleflb@users.noreply.github.com>

* Revert visual referee recording

* Fix rebase error

* Fix shoulder angle calculation

---------

Co-authored-by: ole.flb <45100017+oleflb@users.noreply.github.com>
Co-authored-by: knoellle <33729490+knoellle@users.noreply.github.com>
oleflb added a commit that referenced this pull request Sep 30, 2024
* Renaming thresholds

* Filter poses by keypoint confidences

* Renaming

* Draw bounding box of pose

* Seperate confidence filters for important and other keypoints

* Add pose filter, seperate filtered and unfiltered poses

* Rename object_detection parameters object to pose_detection

* Fix pose subscription path

* Add switch between unfiltered and filtered pose painting

Format

* Add pose detection dead zone indicator

* Increase `pose_detection.bounding_box_confidence_threshold`

* Bump twix

* Split uses correctly

* Split uses here correctly as well

* Fix rebase error

* Address review comments die Erste

* Address review comments die Zweite

Co-authored-by: ole.flb <45100017+oleflb@users.noreply.github.com>
Co-authored-by: knoellle <33729490+knoellle@users.noreply.github.com>

* Draw accepted, rejected and referee pose kind positions in twix map panel

Co-authored-by: ole.flb <45100017+oleflb@users.noreply.github.com>

* Revert visual referee recording

* Fix rebase error

* Fix shoulder angle calculation

---------

Co-authored-by: ole.flb <45100017+oleflb@users.noreply.github.com>
Co-authored-by: knoellle <33729490+knoellle@users.noreply.github.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
Status: Done
Development

Successfully merging this pull request may close these issues.

2 participants