Skip to content
This is breakout game based on the openpose plugin
Branch: master
Clone or download
Fetching latest commit…
Cannot retrieve the latest commit at this time.
Permalink
Type Name Latest commit message Commit time
Failed to load latest commit information.
.github
3rdparty
OpenPosePlugin
Unity Test Projects
doc/media
LICENSE
README.md

README.md


OpenPose Unity Plugin

OpenPose represents the first real-time multi-person system to jointly detect human body, hand, facial, and foot keypoints (in total 135 keypoints) on single images.

This repository is developed to create an OpenPose plugin for Unity users. It uses OpenPose version 1.5 or newer and provides formatted OpenPose output and some examples.

NOTICE

This is an alpha release, everything is subject to change. The plugin will finally be available in Unity Assets store in the future.

Contents

  1. Results
  2. Installation, Reinstallation and Uninstallation
  3. Authors and Contributors
  4. Citation
  5. License

Results

Body and Foot Estimation

Body, Foot, Face, and Hands Estimation

Installation, Reinstallation and Uninstallation

Follow the steps:

  1. Clone or download the project into your local machine.
  2. Go to “OpenPosePlugin/Assets/OpenPose/” folder and run "getPlugins.bat". This will automatically download and unzip OpenPose plugins.
  3. Go to “OpenPosePlugin/Assets/StreamingAssets/models/” folder and run "getModels.bat". This will automatically download required models for OpenPose.
  4. Read the detailed documentation and make sure the portable OpenPose binaries work in your machine.
  5. Open Unity editor and run the "Demo.unity" in "OpenPosePlugin/Assets/OpenPose/Examples/Scenes/".
  6. You can optionally read the UML diagram for more information.

Authors and Contributors

OpenPose Unity Plugin is authored by Tianyi Zhao, Gines Hidalgo, and Yaser Sheikh. Currently, it is being maintained by Tianyi Zhao and Gines Hidalgo.

Citation

Please cite these papers in your publications if it helps your research (the face keypoint detector was trained using the procedure described in [Simon et al. 2017] for hands):

@inproceedings{cao2018openpose,
  author = {Zhe Cao and Gines Hidalgo and Tomas Simon and Shih-En Wei and Yaser Sheikh},
  booktitle = {arXiv preprint arXiv:1812.08008},
  title = {Open{P}ose: realtime multi-person 2{D} pose estimation using {P}art {A}ffinity {F}ields},
  year = {2018}
}

@inproceedings{cao2017realtime,
  author = {Zhe Cao and Tomas Simon and Shih-En Wei and Yaser Sheikh},
  booktitle = {CVPR},
  title = {Realtime Multi-Person 2D Pose Estimation using Part Affinity Fields},
  year = {2017}
}

@inproceedings{simon2017hand,
  author = {Tomas Simon and Hanbyul Joo and Iain Matthews and Yaser Sheikh},
  booktitle = {CVPR},
  title = {Hand Keypoint Detection in Single Images using Multiview Bootstrapping},
  year = {2017}
}

@inproceedings{wei2016cpm,
  author = {Shih-En Wei and Varun Ramakrishna and Takeo Kanade and Yaser Sheikh},
  booktitle = {CVPR},
  title = {Convolutional pose machines},
  year = {2016}
}

Links to the papers:

License

OpenPose Unity Plugin is freely available for free non-commercial use, and may be redistributed under these conditions. Please, see the license for further details. Interested in a commercial license? Check this FlintBox link. For commercial queries, use the Directly Contact Organization section from the FlintBox link and also send a copy of that message to Yaser Sheikh.

You can’t perform that action at this time.