Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Fix metric for small distances #32

Merged
merged 7 commits into from
Aug 30, 2023
Merged

Fix metric for small distances #32

merged 7 commits into from
Aug 30, 2023

Conversation

tlpss
Copy link
Owner

@tlpss tlpss commented Aug 30, 2023

There was a bug in the metrics that caused the heatmap generation and hence the metric to fail for d=1 if the keypoints were annotated as floats.
This is now fixed by casting keypoints to the top-left (zero-index as in COCO) keypoint before training.

  • make sure keypoints are cast to zero-indexed integers before training
  • make sure heatmaps are centered on that pixel
  • make sure the AP for d=0 (i.e pixel-perfect keypoints) goes up to 1 for a dummy dataset (integration testing)

- all keypoints are in ints (and represent topleft corner of their pixel, aka zero-indexed)
- heatmaps are really centered on the int pixel
- metric max distances are ints and represent <= L2 distances (i.e. pixel-perfect == dmax = 0)
- integration test: dummy dataset results in good scores for all mAP threholds down to 0
@tlpss tlpss merged commit 9f39a8e into main Aug 30, 2023
2 checks passed
@tlpss tlpss deleted the metric-scrutinization branch August 30, 2023 10:07
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

1 participant