For the full setup guide, click on the link above to access the wiki!
Ask in the help channel of our discord server: https://discord.gg/g2ctkXB4bb
Full-body tracking in VR using AprilTag markers.
This is my second attempt at creating a full-body tracking system using fiducial markers. This should enable people to get fullbody tracking for free, using only a phone and some cardboard. It is possible to get pretty good tracking with trackers of sizes as small as 10cm and a PS eye camera of 640x480 resolution. Increasing the marker size or using a higher resolution and faster phone camera further improves tracking.
NOTE: THIS IS A FREE AND OPEN SOURCE PROJECT. YOU DO NOT NEED DRIVER4VR FOR THIS!
To use, you will have to make three trackers - one for each leg and one for hips. Using only leg trackers will not work in VRChat!
This version uses the much more accurate AprilTag system and includes many improvements to make the system easier to use, such as a GUI interface and a more straight forward calibration.
If you have any issues or encounter any bugs, feel free to open an issue on github or message me on discord: https://discord.gg/g2ctkXB4bb
The program can be downloaded from the releases tab.
Beatsaber demo: https://youtu.be/Akps-dH0EeA
I am too bad at making actual tutorials, but I did record a short video of me setting up everything. Its not a replacement for the tutorial bellow, but it may help you understand some of the steps better.
NOTE: THIS IS ONLY FOR DEVELOPERS. IF YOU ONLY WANT TO USE APRILTAGTRACKERS AND NOT WRITE CODE, THE TUTORIAL IS ON THE WIKI
A detailed build instructions will be here, some day. For the instructions on how to install and use ATT, refer to the link to the wiki on the top of the page!
The project is a CMAKE project. You should be able to build it either using CMAKE and your favourite IDE/compiler, or some IDES already support opening cmake projects directly. It should also work both on Windows and Linux.
The only library you need to install seperately is opencv with contrib modules (aruco, specificaly). You should be able to find a guide on how to do that.
So:
- Build opencv with contrib modules
- Generate project with CMAKE, if opencv isnt found automaticaly, point cmake to its build directory
- Open generated project with your favourite c++ IDE and compile!
- The compiled .exe will need some additional dlls to work. Simplest way to do this is just to copy the missing dlls to the same folder the .exe is in (or into build/ApriltagTrackers if running from IDE). The opencv dlls are in the opencv build directory, openvr is in the openvr/bin directory.
That should be it! In case you try it before a more detailed guide is up, we are always there to help on the discord server! (link above)
Olson, Edwin. "AprilTag: A robust and flexible visual fiducial system." 2011 IEEE International Conference on Robotics and Automation. IEEE, 2011.
https://github.com/AprilRobotics/apriltag
WxWidgets: A Cross-Platform GUI Library