Object detection Touchdesigner bounding boxes not aligned

[mikebru]

I noticed while using the object detection portion of the TOX that the bounding boxes that Touchdesginer is drawing do not align with bounding boxes that Mediapipe is drawing. They are offset and don't accurately map back onto the video.

Thanks for putting this resource together, it is a really great tool and addition to touchdesigner!

[domisjustanumber]

Hi @mikebru thanks for letting us know - we'll take a look at the code and see what's going on.

[mettapana]

I also observe the same thing here. It doesn't look like a translation or scaling problem in instance space. It seems that the objects are in other positions randomly.

I am great to see the possibility of using mediapipe in TD. Thanks for this project.

[benjavides]

I did some testing with the different releases. Here are the results:

• v0.3.2 bounding box error
• v0.3.1 bounding box error
• v0.2.2 working correctly
• v0.2.0 working correctly

Here is a picture of what the error looks like (v0.3.2)

In the MediaPipe OP the bounding box is not showed at all, it is collapsed in the corner. But it's not all zeros because in the object_tracking OP we see the bounding box, just in the wrong position. The size seems to be right.

Tested with a webcam on Touchdesigner 2022.35280. In all cases only the Detect objects toggle was enabled in the MediaPipe OP.

[domisjustanumber]

I spent a few hours this week fixing up all the bounding boxes for the object tracking and added them for the face tracking too.

The changes are all checked in, so will be there next time we do a release build.

[domisjustanumber]

This fix got released in v0.3.3 so closing this issue :)