Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Expose mediapipe config option "min_pose_detection_confidence" #309

Closed
Ale1 opened this issue Jun 8, 2023 · 2 comments
Closed

Expose mediapipe config option "min_pose_detection_confidence" #309

Ale1 opened this issue Jun 8, 2023 · 2 comments
Labels
wontfix This will not be worked on

Comments

@Ale1
Copy link

Ale1 commented Jun 8, 2023

Is your feature request related to a problem? Please describe.
The pose landmark detection model seems to be using the default value of the param "min_pose_detection_confidence". The effects of this value can be seen here: https://mediapipe-studio.webapps.google.com/demo/pose_landmarker. And the documentation for this param here: https://developers.google.com/mediapipe/solutions/vision/pose_landmarker#configurations_options.

We find this value (of 0.5f) to be too permissive, as its easy to "trick" the model into detecting random hands waving in front of the camera as a person. Using the Web SDK of blaze pose with a min_pose_detection_confidence of > 0.7f seems to work better with way fewer false positives.

Describe the solution you'd like
It would be ideal for this blaze pose param to be exposed in the Blazepose.Options.PoseLandmarkDetect.Options as a public float.

Describe alternatives you've considered
We tried playing with the Score threshold that is part of the Options, but it only affects the drawing rather than the detection itself. Also, we tried to change the "Score" filter on the landmarks (currently hardcoded to filter out <0.2. However, even bad quality inputs are being delivered with scores above 0.7, so its hard to to use this method to segregate bad and good quality inputs.

Additional context

Here is example of "min_pose_detection_confidence" scores set at default 0.5 and then at 0.8. With lower score, its easy to trick the detection model into thinking an arm is a person laying horizontally, with fingers being detected as limbs and wrist as shoulders. With score of 0.8, we can filter those cases out.

Screenshot 2023-06-08 at 10 22 03
Screenshot 2023-06-08 at 10 22 14

@SusheelNath
Copy link

Hi @asus4, to also add to the above, @Ale1 and I tried that on multiple devices (iPad 2021 12.9, iPhone 12 Pro, Samsung Galaxy S10 to name a few) and this occurs on all.

@Ale1 Ale1 changed the title Expose blaze pose config "min_pose_detection_confidence" Expose mediapipe config option "min_pose_detection_confidence" Jun 11, 2023
@stale
Copy link

stale bot commented Aug 11, 2023

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions.

@stale stale bot added the wontfix This will not be worked on label Aug 11, 2023
@stale stale bot closed this as completed Aug 18, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
wontfix This will not be worked on
Projects
None yet
Development

No branches or pull requests

2 participants