By Jonathan Andrei

For viewing the results, download and extract the folder: https://drive.google.com/file/d/1gc9jy-HGiN4IyLz7DRfmMDcaOpfsy8A4/view?usp=sharing

It was too large to include in the repository.

Motion Capture Hand

1. Adafruit Unified Sensor
2. Adafruit BNO055
3. Blender
4. The motion capture hand made for this project.

Steps

1. Plug in Arduino with everything connected.
2. Open the global arduino file and upload the code.
3. Open blender and navigate to the scripting window
4. run the imuDataManipulator.py and operator_hand.py with alt-p within the blender environment.
5. Navigate to the layout window and press f3 (or fn f3 on certain laptops) and search for Activate Hand
6. Press enter and everything will start to run

Note

It takes around 3 seconds for the bones to orient itself properly upon running the script.

For more details on the project, feel free to read the report.pdf document.

Sources

[1] Madgwick, S., 2010. An efficient orientation filter for inertial and inertial/magnetic sensor arrays. [ebook] samba.org. Available at: https://www.samba.org/tridge/UAV/madgwick_internal_report.pdf [Accessed 5 December 2021].

[2] Youtube.com. Paul McWhorter Youtube Channel. [online] Available at: https://www.youtube.com/user/mcwhorpj [Accessed 5 December 2021].

[3] Adafruit BNO055 Absolute Orientation Sensor. Adafruit. [online] Available at: https://learn.adafruit.com/adafruit-bno055-absolute-orientation-sensor [Accessed 5 December 2021].

[4] 2021. Blender 3.0.0 Python API Documentation. Blender. [online] Available at: https://docs.blender.org/api/current/index.html [Accessed 5 December 2021].

[5] Conversion between quaternions and Euler angles. 2021. [ebook] Wikipedia. Available at: https://en.wikipedia.org/wiki/Conversion_between_quaternions_and_Euler_angles [Accessed 5 December 2021].

[6] An, L., Wang, L., Liu, N., Fu, J. and Zhong, Y., 2019. A Novel Method for Estimating Pitch and Yaw of Rotating Projectiles Based on Dynamic Constraints. ncbi.nlm.nih.gov. Available at: https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6928913/ [Accessed 5 December 2021].

[7] Campbell, S., 2021. Basics of the I2C Communication Protocol. [online] Circuit Basics. Available at: https://www.circuitbasics.com/basics-of-the-i2c-communication-protocol [Accessed 5 December 2021].

[8] Processing Reference. 2021. [online] Available at: https://processing.org/reference/ [Accessed 5 December 2021].

[9] Wikipedia. 2021. Quaternion. [online] Available at: https://en.wikipedia.org/wiki/Quaternion [Accessed 5 December 2021].