Repository navigation
V1.1
Pre-release
Pre-release
New additions:
- Rotating camera, change parameter to add this
- Linear interpolation instead of relying on just kalman prediction
- Able to handle more configs
- Fix issue with rotation and parenting, can change setting in yaml file
Issues
- The parenting of object is very dependent on the SMPL pose. So if the SMPL pose is wrong, the object's transformations are not very accurate and may look even worse. Reason for this is the first frame the object is detected to be attached to a joint (distance check) it will use that offset. But if the initial pose causes the joint in that frame to be at an inaccurate position, then the offset will be inaccurate.
- Not being able to detect fast moving objects for videos with low frame rate. The application heavily relies on object detector and tracking for rendering objects. Without those it is hard to accurately render the object and attach it to the correct humans. Using a 60fps video with 4k resolution seemed to make the detection and tracking more accurate
- When the camera rotates, keypoint attachment issues is more prominent. It is hard to tell depth based on a monocular video, which makes it hard to tell which hand is interacting with the ball