Awesome work on hand pose estimation/tracking
Clone or download
Permalink
Type Name Latest commit message Commit time
Failed to load latest commit information.
evaluation add evaluation for WACV'19 paper Jan 16, 2019
.gitignore add evaluation codes May 30, 2017
README.md fix broken link Jan 8, 2019

README.md

Awesome Work on Hand Pose Estimation

Table of Contents

Evaluation

See folder evaluation to get more details about performance evaluation for hand pose estimation.

arXiv Papers

[arXiv:1812.08028] Accurate Hand Keypoint Localization on Mobile Devices. [PDF]

Filippos Gouidis, Paschalis Panteleris, Iason Oikonomidis, Antonis Argyros

[arXiv:1812.02050] Point-to-Pose Voting based Hand Pose Estimation using Residual Permutation Equivariant Layer. [PDF]

Shile Li, Dongheui Lee

[arXiv:1812.01598] Monocular Total Capture: Posing Face, Body, and Hands in the Wild. [PDF]

Donglai Xiang, Hanbyul Joo, Yaser Sheikh

[arXiv:1812.01002] Disentangling Latent Hands for Image Synthesis and Pose Estimation. [PDF]

Linlin Yang, Angela Yao

[arXiv:1811.09916] Generating Realistic Training Images Based on Tonality-Alignment Generative Adversarial Networks for Hand Pose Estimation. [PDF]

Liangjian Chen, Shih-Yao Lin, Yusheng Xie, Hui Tang, Yufan Xue, Xiaohui Xie, Yen-Yu Lin, Wei Fan

[arXiv:1811.07123] RGB-based 3D Hand Pose Estimation via Privileged Learning with Depth Images. [PDF]

Shanxin Yuan, Bjorn Stenger, Tae-Kyun Kim

[arXiv:1811.07123] Explicit Pose Deformation Learning for Tracking Human Poses. [PDF]

Xiao Sun, Chuankang Li, Stephen Lin

[arXiv:1809.06268] Vision-based Teleoperation of Shadow Dexterous Hand using End-to-End Deep Neural Network. [PDF] [Code]

Shuang Li*, Xiaojian Ma*, Hongzhuo Liang, Michael Görner, Philipp Ruppel, Bing Fang, Fuchun Sun, Jianwei Zhang

[arXiv:1807.00898] Model-based Hand Pose Estimation for Generalized Hand Shape with Appearance Normalization. [PDF]

Jan Wöhlke, Shile Li, Dongheui Lee

[arXiv:1705.09606] End-to-end Global to Local CNN Learning for Hand Pose Recovery in Depth data. [PDF]

Meysam Madadi, Sergio Escalera, Xavier Baro, Jordi Gonzalez

[arXiv:1704.02224] Hand3D: Hand Pose Estimation using 3D Neural Network. [PDF] [Project Page]

Xiaoming Deng*, Shuo Yang*, Yinda Zhang*, Ping Tan, Liang Chang, Hongan Wang

[arXiv:1612.00596] Learning to Search on Manifolds for 3D Pose Estimation of Articulated Objects. [PDF]

Yu Zhang, Chi Xu, Li Cheng

[back to top]

Journal Papers

TPAMI / IJCV

[2018 TPAMI] Opening the Black Box: Hierarchical Sampling Optimization for Hand Pose Estimation. [PDF]

Danhang Tang*, Qi Ye*, Shanxin Yuan, Jonathan Taylor, Pushmeet Kohli, Cem Keskin, Tae-Kyun Kim, Jamie Shotton

[2018 IJCV] Depth-Based Hand Pose Estimation: Methods, Data, and Challenges. [PDF] [Project Page] [Code]

James Steven Supančič III, Grégory Rogez, Yi Yang, Jamie Shotton, Deva Ramanan

[2018 TPAMI] Real-time 3D Hand Pose Estimation with 3D Convolutional Neural Networks. [PDF]

Liuhao Ge, Hui Liang, Junsong Yuan and Daniel Thalmann

[2016 IJCV] Lie-X: Depth Image Based Articulated Object Pose Estimation, Tracking, and Action Recognition on Lie Groups. [PDF] [Project Page]

Chi Xu, Lakshmi Narasimhan Govindarajan, Yu Zhang, Li Cheng

[2016 TPAMI] Latent Regression Forest: Structured Estimation of 3D Hand Poses. [PDF]

Danhang Tang, Hyung Chang, Alykhan Tejani, Tae-Kyun Kim

[2016 IJCV] Capturing Hands in Action using Discriminative Salient Points and Physics Simulation. [PDF] [Project Page]

Dimitrios Tzionas, Luca Ballan, Abhilash Srikantha, Pablo Aponte, Marc Pollefeys, Juergen Gall

[2015 IJCV] Estimate Hand Poses Efficiently from Single Depth Images. [PDF] [Project Page] [Code]

Chi Xu, Ashwin Nanjappa, Xiaowei Zhang, Li Cheng

[back to top]

Others

[2018 Neurocomputing] A CRNN module for hand pose estimation. [PDF]

Zhongxu Hu, Youmin Hu, Jie Liu, Bo Wu, Dongmin Han, Thomas Kurfess

[2018 IVC] Large-scale Multiview 3D Hand Pose Dataset. [PDF] [Project Page]

Francisco Gomez-Donoso, Sergio Orts-Escolano and Miguel Cazorla

[2018 TCSVT] Mask-pose Cascaded CNN for 2D Hand Pose Estimation from Single Color Image. [PDF]

Yangang Wang, Cong Peng and Yebin Liu

[2018 IVC] Top-down model fitting for hand pose recovery in sequences of depth images. [PDF]

Meysam Madadi, Sergio Escalera, Alex Carruesco, Carlos Andujar, Xavier Baró, Jordi Gonzàlez

[2018 TCYB] Context-Aware Deep Spatio-Temporal Network for Hand Pose Estimation from Depth Images. [PDF]

Yiming Wu, Wei Ji, Xi Li, Gang Wang, Jianwei Yin, Fei Wu

[2018 IEEE Access] SHPR-Net: Deep Semantic Hand Pose Regression From Point Clouds. [PDF] [Project Page]

Xinghao Chen, Guijin Wang, Cairong Zhang, Tae-Kyun Kim, Xiangyang Ji

[2018 Neurocomputing] Pose Guided Structured Region Ensemble Network for Cascaded Hand Pose Estimation. [PDF] [Project Page] [Code]

Xinghao Chen, Guijin Wang, Hengkai Guo, Cairong Zhang

[2018 PR] Learning a deep network with spherical part model for 3D hand pose estimation. [PDF]

Tzu-Yang Chen, Pai-Wen Ting, Min-Yu Wu, Li-Chen Fu

[2018 TIP] Robust 3D Hand Pose Estimation from Single Depth Images using Multi-View CNNs. [PDF]

Liuhao Ge, Hui Liang, Junsong Yuan and Daniel Thalmann

[2018 JVCI] Region Ensemble Network: Towards Good Practices for Deep 3D Hand Pose Estimation. [PDF] [Code]

Guijin Wang, Xinghao Chen*, Hengkai Guo*, Cairong Zhang

[2017 TCYB] Hough Forest with Optimized Leaves for Global Hand Pose Estimation with Arbitrary Postures. [PDF]

Hui Liang, Junsong Yuan, J. Lee, Liuhao Ge and Daniel Thalmann

[2017 TCSVT] Robust RGB-D Hand Tracking Using Deep Learning Priors. [PDF]

Jordi Sanchez-Riera, Kathiravan Srinivasan, Kai-Lung Hua, Wen-Huang Cheng, M. Anwar Hossain, and Mohammed F. Alhamid

[2017 CVIU] Hand Pose Estimation through Semi-Supervised and Weakly-Supervised Learning. [PDF]

Natalia Neverova, Christian Wolf, Florian Nebout, Graham Taylor

[2017 Neurocomputing] Multi-task, Multi-domain Learning: application to semantic segmentation and pose regression. [PDF]

Damien Foururea, Rémi Emonet, Elisa Fromont, Damien Muselet, Natalia Neverova, Alain Trémeaua, Christian Wolf

[2016 CVIU] Guided Optimisation through Classification and Regression for Hand Pose Estimation. [PDF] [Project Page]

Philip Krejov, Andrew Gilbert, Richard Bowden

[2015 TCSVT] Resolving Ambiguous Hand Pose Predictions by Exploiting Part Correlations. [PDF]

Hui Liang, Junsong Yuan, Daniel Thalmann

[2014 TMM] Parsing the Hand in Depth Images. [PDF] [Project Page] [Code]

Hui Liang, Junsong Yuan, Daniel Thalmann

[back to top]

Conference Papers

2019 Others

[2019 WACV] MURAUER: Mapping Unlabeled Real Data for Label AUstERity. [PDF] [Project Page] [Code]

Georg Poier, Michael Opitz, David Schinagl and Horst Bischof

[back to top]

2018 ECCV

HandMap: Robust Hand Pose Estimation via Intermediate Dense Guidance Map Supervision. [PDF] [Project Page] [Code]

Xiaokun Wu, Daniel Finnegan, Eamonn O'Neill, Yongliang Yang

HBE: Hand Branch Ensemble network for real time 3D hand pose estimation. [PDF]

Yidan Zhou, Jian Lu, Kuo Du, Xiangbo Lin, Yi Sun, Xiaohong Ma

Point-to-Point Regression PointNet for 3D Hand Pose Estimation. [PDF]

Liuhao Ge, Zhou Ren, Junsong Yuan

Weakly-supervised 3D Hand Pose Estimation from Monocular RGB Images. [PDF] (Oral)

Yujun Cai, Liuhao Ge, Jianfei Cai, Junsong Yuan

Joint 3D tracking of a deformable object in interaction with a hand. [PDF] [Project Page]

Aggeliki Tsoli, Antonis A. Argyros

Occlusion-aware Hand Pose Estimation Using Hierarchical Mixture Density Network. [PDF] (Oral)

Qi Ye, Tae-Kyun Kim

Hand Pose Estimation via Latent 2.5D Heatmap Regression. [PDF]

Umar Iqbal, Pavlo Molchanov, Thomas Breuel, Juergen Gall, Jan Kautz

[Hands18 Workshop] Adapting Egocentric Visual Hand Pose Estimation Towards a Robot-Controlled Exoskeleton. [PDF]

Gerald Baulig, Thomas Gulde, Cristobal Curio

[Hands18 Workshop] Estimating 2D Multi-Hand Poses From Single Depth Images. [PDF]

Le Duan, Minmin Shen, Song Cui, Zhexiao Guo, Oliver Deussen

[Hands18 Workshop] Task-Oriented Hand Motion Retargeting for Dexterous Manipulation Imitation. [PDF] [Project Page]

Dafni Antotsiou, Guillermo Garcia-Hernando, Tae-Kyun Kim

[back to top]

2018 CVPR

First-Person Hand Action Benchmark with RGB-D Videos and 3D Hand Pose Annotations. [PDF] [Project Page] [Code]

Guillermo Garcia-Hernando, Shanxin Yuan, Seungryul Baek, Tae-Kyun Kim

Learning Pose Specific Representations by Predicting Different Views. [PDF] [Project Page] [Code]

Georg Poier, David Schinagl, Horst Bischof

Hand PointNet: 3D Hand Pose Estimation using Point Sets. [PDF] [Project Page] [Code] (Spotlight)

Liuhao Ge, Yujun Cai, Junwu Weng, Junsong Yuan

Dense 3D Regression for Hand Pose Estimation. [PDF] [Code]

Chengde Wan, Thomas Probst, Luc Van Gool, Angela Yao

Cross-modal Deep Variational Hand Pose Estimation. [PDF] [Project Page] [Code] (Spotlight)

Adrian Spurr, Jie Song, Seonwook Park, Otmar Hilliges

Feature Mapping for Learning Fast and Accurate 3D Pose Inference from Synthetic Images. [PDF] [Project Page]

Mahdi Rad, Markus Oberweger, Vincent Lepetit

GANerated Hands for Real-Time 3D Hand Tracking from Monocular RGB. [PDF] [Supp] [Project Page] (Spotlight)

Franziska Mueller, Florian Bernard, Oleksandr Sotnychenko, Dushyant Mehta, Srinath Sridhar, Dan Casas, Christian Theobalt

V2V-PoseNet: Voxel-to-Voxel Prediction Network for Accurate 3D Hand and Human Pose Estimation from a Single Depth Map. [PDF] [Code]

Gyeongsik Moon, Ju Yong Chang, Kyoung Mu Lee

Depth-Based 3D Hand Pose Estimation: From Current Achievements to Future Goals. [PDF] (Spotlight)

Shanxin Yuan, Guillermo Garcia-Hernando, Bjorn Stenger, Gyeongsik Moon, Ju Yong Chang, Kyoung Mu Lee, Pavlo Molchanov, Jan Kautz, Sina Honari, Liuhao Ge, Junsong Yuan, Xinghao Chen, Guijin Wang, Fan Yang, Kai Akiyama, Yang Wu, Qingfu Wan, Meysam Madadi, Sergio Escalera, Shile Li, Dongheui Lee, Iason Oikonomidis, Antonis Argyros, Tae-Kyun Kim

Augmented skeleton space transfer for depth-based hand pose estimation. [PDF] (Oral)

Seungryul Baek, Kwang In Kim, Tae-Kyun Kim

[3D HUMANS Workshop] Monocular RGB Hand Pose Inference From Unsupervised Refinable Nets. [PDF]

Endri Dibra, Silvan Melchior, Ali Balkis, Thomas Wolf, Cengiz Oztireli, Markus Gross

[back to top]

2018 Others

[2018 ACCV] Hand Pose Estimation based on 3D Residual Network with Data Padding and Skeleton Steadying. [PDF]

Pai-Wen Ting, En-Te Chou, Ya-Hui Tang, Li-Chen Fu

[2018 ACCV] Partially Occluded Hands: A challenging new dataset for single-image hand pose estimation. [PDF] [Project Page] (Oral)

Battushig Myanganbayar, Cristina Mata, Gil Dekel, Boris Katz, Guy Ben-Yosef, Andrei Barbu

[2018 ACCV] Domain Transfer for 3D Pose Estimation from Color Images without Manual Annotations. [PDF] (Oral)

Mahdi Rad, Markus Oberweger, Vincent Lepetit

[2018 PCM] Hand Pose Estimation with Attention-and-Sequence Network. [PDF]

Tianping Hu*, Wenhai Wang*, Tong Lu

[2018 PCM] Mutiple Transfer Net with Region Ensemble for Deep Hand Pose Estimation. [PDF]

Haoqian Wang, Da Li, Xingzheng Wang

[2018 ICPR] Local Regression Based Hourglass Network for Hand Pose Estimation from a Single Depth Image. [PDF]

Jia Li, Zengfu Wang

[2018 ICPR] Dynamic Projected Segmentation Networks for Hand Pose Estimation. [PDF]

Yunlong Che, Yue Qi

[2018 3DV] DeepHPS: End-to-end Estimation of 3D Hand Pose and Shape by Learning from Synthetic Depth. [PDF]

Jameel Malik, Ahmed Elhayek, Fabrizio Nunnari, Kiran Varanasi, Kiarash Tamaddon, Alexis Heloir, Didier Stricker

[2018 ICIP] Networks Effectively Utilizing 2D Spatial Information for Accurate 3D Hand Pose Estimation. [PDF]

Baoen Liu, Shiliang Huang, Zhongfu Ye

[2018 ICIP] On the Fusion of RGB and Depth Information For Hand Pose Estimation. [PDF] [Code]

Evangelos Kazakos, Christophoros Nikou, Ioannis Kakadiaris

[2018 ICIP] Fast Lifting for 3D Hand Pose Estimation in AR/VR Applications. [PDF]

Onur Guleryuz, Christine Kaeser-Chen

[2018 BMVC] Structure-Aware 3D Hourglass Network for Hand Pose Estimation from Single Depth Image. [PDF]

Fuyang Huang, Ailing Zeng, Minhao Liu, Jing Qin, Qiang Xu

[2018 BMVC] 3D Hand Pose Estimation using Simulation and Partial-Supervision with a Shared Latent Space. [PDF] [Code] (Oral)

Masoud Abdi, Ehsan Abbasnejad, Chee Peng Lim, Saeid Nahavandi

[2018 FG] Kinematic Constrained Cascaded Autoencoder for Real-time Hand Pose Estimation. [PDF]

Yushun Lin, Xiujuan Chai, Xilin Chen

[2018 WACV] Using a single RGB frame for real time 3D hand pose estimation in the wild. [PDF] [Project Page]

Paschalis Panteleris, Iason Oikonomidis, Antonis Argyros

[back to top]

2017 ICCV

Learning to Estimate 3D Hand Pose from Single RGB Images. [PDF] [Project Page] [Code]

Christian Zimmermann, Thomas Brox

Real-time Hand Tracking under Occlusion from an Egocentric RGB-D Sensor. [PDF] [Project Page]

Franziska Mueller, Dushyant Mehta, Oleksandr Sotnychenko, Srinath Sridhar, Dan Casas, Christian Theobalt

Robust Hand Pose Estimation during the Interaction with an Unknown Object. [PDF] [Supp] [Project Page]

Chiho Choi, Sang Ho Yoon, Chin-Ning Chen, Karthik Ramani

Learning Hand Articulations by Hallucinating Heat Distribution. [PDF] [Supp] [Project Page]

Chiho Choi, Sangpil Kim, Karthik Ramani

Low-Dimensionality Calibration through Local Anisotropic Scaling for Robust Hand Model Personalization. [PDF] [Project Page] [Code]

Edoardo Remelli*, Anastasia Tkach*, Andrea Tagliasacchi, Mark Pauly

[Hands17 Workshop] Back to RGB: 3D tracking of hands and hand-object interactions based on short-baseline stereo. [PDF]

Paschalis Panteleris, Antonis Argyros

[Hands17 Workshop] DeepPrior++: Improving Fast and Accurate 3D Hand Pose Estimation. [PDF] [Project Page] [Code]

Markus Oberweger and Vincent Lepetit

[Hands17 Workshop] Hand Pose Estimation Using Deep Stereovision and Markov-chain Monte Carlo. [PDF]

Rilwan Remilekun Basaru, Chris Child, Eduardo Alonso, Greg Slabaugh

[back to top]

2017 CVPR

Hand Keypoint Detection in Single Images using Multiview Bootstrapping. [PDF] [Project Page] [Code]

Tomas Simon, Hanbyul Joo, Iain Matthews, Yaser Sheikh

Crossing Nets: Combining GANs and VAEs with a Shared Latent Space for Hand Pose Estimation. [PDF] [Code]

Chengde Wan, Thomas Probst, Luc Van Gool, Angela Yao

Big Hand 2.2M Benchmark: Hand Pose Data Set and State of the Art Analysis. [PDF]

Shanxin Yuan*, Qi Ye*, Bjorn Stenger, Siddhand Jain, Tae-Kyun Kim

3D Convolutional Neural Networks for Efficient and Robust Hand Pose Estimation from Single Depth Images. [PDF] [Project Page]

Liuhao Ge, Hui Liang, Junsong Yuan and Daniel Thalmann

[back to top]

2017 Others

[2017 3DV] Simultaneous Hand Pose and Skeleton Bone-Lengths Estimation from a Single Depth Image. [PDF]

Jameel Malik, Ahmed Elhayek, Didier Stricker

[2017 3DV] How to Refine 3D Hand Pose Estimation from Unlabelled Depth Data? [PDF]

Endri Dibra*, Thomas Wolf*, Cengiz Öztireli, Markus Gross

[2017 ICIP] Region Ensemble Network: Improving Convolutional Network for Hand Pose Estimation. [PDF] [Code]

Hengkai Guo, Guijin Wang, Xinghao Chen, Cairong Zhang, Fei Qiao, Huazhong Yang

[2017 ICIP] A Hand Pose Tracking Benchmark from Stereo Matching. [PDF] [Project Page]

Jiawei Zhang, Jianbo Jiao, Mingliang Chen, Liangqiong Qu, Xiaobin Xu, and Qingxiong Yang

[2017 SIGGRAPH Asia] Articulated distance fields for ultra-fast tracking of hands interacting. [PDF]

Jonathan Taylor*, Vladimir Tankovich*, Danhang Tang*, Cem Keskin*, David Kim, Philip Davidson, Adarsh Kowdle, Shahram Izadi

[2017 SIGGRAPH Asia] Online Generative Model Personalization for Hand Tracking. [PDF] [Project Page]

Anastasia Tkach*, Andrea Tagliasacchi*, Edoardo Remelli, Mark Pauly, Andrew Fitzgibbon

[2017 SIGGRAPH Asia] Embodied Hands: Modeling and Capturing Hands and Bodies Together. [PDF] [Project Page]

Javier Romero*, Dimitrios Tzionas* and Michael J. Black

[2017 BMVC] Hand Pose Learning: Combining Deep Learning and Hierarchical Refinement for 3D Hand Pose Estimation. [PDF]

Min-Yu Wu, Ya Hui Tang, Pai-Wei Ting and Li-Chen Fu

[2017 BMVC] Generative 3D Hand Tracking with Spatially Constrained Pose Sampling. [PDF] [Project Page]

Konstantinos Roditakis, Alexandros Makris and Antonis Argyros

[2017 ICRA] Learning a deep network with spherical part model for 3D hand pose estimation. [PDF]

Tzu-Yang Chen, Pai-Wen Ting, Min-Yu Wu, Li-Chen Fu

[2017 FG] Occlusion aware hand pose recovery from sequences of depth images. [PDF] [Slide]

Meysam Madadi, Sergio Escalera, Alex Carruesco Llorens, Carlos Andujar, Xavier Baro, Jordi Gonzalez

[2017 FG] 3D Hand-Object Pose Estimation from Depth with Convolutional Neural Networks. [PDF] [Project Page]

Duncan Goudie, Aphrodite Galata

[back to top]

2016 ECCV

Spatial Attention Deep Net with Partial PSO for Hierarchical Hybrid Hand Pose Estimation. [PDF] [Project Page]

Qi Ye*, Shanxin Yuan*, Tae-Kyun Kim

Hand Pose Estimation from Local Surface Normals. [PDF]

Chengde Wan, Angela Yao, and Luc Van Gool

Real-time Joint Tracking of a Hand Manipulating an Object from RGB-D Input. [PDF] [Project Page]

Srinath Sridhar, Franziska Mueller, Michael Zollhöfer, Dan Casas, Antti Oulasvirta, Christian Theobalt

[back to top]

2016 CVPR

Robust 3D Hand Pose Estimation in Single Depth Images: From Single-View CNN to Multi-View CNNs. [PDF] [Project Page] [Code]

Liuhao Ge, Hui Liang, Junsong Yuan, Daniel Thalmann

DeepHand: Robust Hand Pose Estimation by Completing a Matrix Imputed With Deep Features. [PDF][Project Page]

Ayan Sinha*, Chiho Choi*, Karthik Ramani

Efficiently Creating 3D Training Data for Fine Hand Pose Estimation. [PDF] [Project Page] [Code]

Markus Oberweger, Gernot Riegler, Paul Wohlhart, Vincent Lepetit

Fits Like a Glove: Rapid and Reliable Hand Shape Personalization. [PDF] [Project Page]

David Joseph Tan, Thomas Cashman, Jonathan Taylor, Andrew Fitzgibbon, Daniel Tarlow, Sameh Khamis, Shahram Izadi, Jamie Shotton

[back to top]

2016 Others

[2016 ACCV] Hand Pose Regression via A Classification-guided Approach. [PDF]

Hongwei Yang, Juyong Zhang

[2016 ICPR] Deep learning for integrated hand detection and pose estimation. [PDF]

Tzu-Yang Chen, Min-Yu Wu, Yu-Hsun Hsieh, Li-Chen Fu

[2016 ICPR] Depth-based 3D hand pose tracking. [PDF]

Kha Gia Quach, Chi Nhan Duong, Khoa Luu, and Tien D. Bui.

[2016 IJCAI] Model-based Deep Hand Pose Estimation. [PDF] [Project Page] [Code]

Xingyi Zhou, Qingfu Wan, Wei Zhang, Xiangyang Xue, Yichen Wei

[2016 SIGGRAPH] Efficient and precise interactive hand tracking through joint, continuous optimization of pose and correspondences. [PDF]

Jonathan Taylor et al.

[2016 SIGGRAPH Asia] Sphere-Meshes for Real-Time Hand Modeling and Tracking. [PDF] [Project Page] [Code]

Anastasia Tkach, Mark Pauly, Andrea Tagliasacchi

[back to top]

2015 ICCV

Training a Feedback Loop for Hand Pose Estimation. [PDF] [Project Page]

Markus Oberweger, Paul Wohlhart, Vincent Lepetit

Opening the Black Box: Hierarchical Sampling Optimization for Estimating Human Hand Pose. [PDF]

Danhang Tang, Jonathan Taylor, Pushmeet Kohli, Cem Keskin, Tae-Kyun Kim, Jamie Shotton

Depth-based hand pose estimation: data, methods, and challenges. [PDF] [Project Page] [Code]

James Supancic III, Deva Ramanan, Gregory Rogez, Yi Yang, Jamie Shotton

3D Hand Pose Estimation Using Randomized Decision Forest with Segmentation Index Points. [PDF]

Peiyi Li, Haibin Ling

A collaborative filtering approach to real-time hand pose estimation. [PDF] [Project Page]

Chiho Choi, Ayan Sinha, Joon Hee Choi, Sujin Jang, Karthik Ramani

Lending A Hand: Detecting Hands and Recognizing Activities in Complex Egocentric Interactions. [PDF]

Sven Bambach, Stefan Lee, David Crandall, Chen Yu

Understanding Everyday Hands in Action from RGB-D Images. [PDF]

Gregory Rogez, James Supancic III, Deva Ramanan

[back to top]

2015 CVPR

Cascaded Hand Pose Regression. [PDF]

Xiao Sun, Yichen Wei, Shuang Liang, Xiaoou Tang, and Jian Sun

Fast and Robust Hand Tracking Using Detection-Guided Optimization. [PDF] [Project Page]

Srinath Sridhar, Franziska Mueller, Antti Oulasvirta, Christian Theobalt

Learning an Efficient Model of Hand Shape Variation from Depth Images. [PDF]

Sameh Khamis, Jonathan Taylor, Jamie Shotton, Cem Keskin, Shahram Izadi, Andrew Fitzgibbon

[back to top]

2015 Others

[2015 BMVC] Hybrid One-Shot 3D Hand Pose Estimation by Exploiting Uncertainties. [PDF] [Project Page]

Georg Poier, Konstantinos Roditakis, Samuel Schulter, Damien Michel, Horst Bischof and Antonis A. Argyros

[2015 BMVC] Rule of Thumb: Deep Derotation for Improved Fingertip Detection. [PDF] [Project Page]

Aaron Wetzler, Ron Slossberg and Ron Kimmel

[2015 CHI] Accurate, Robust, and Flexible Real-time Hand Tracking. [PDF] [Project Page]

Toby Sharp, Cem Keskin, Duncan Robertson, Jonathan Taylor, Jamie Shotton, David Kim, Christoph Rhemann, Ido Leichter, Alon Vinnikov, Yichen Wei, Daniel Freedman, Pushmeet Kohli, Eyal Krupka, Andrew Fitzgibbon, Shahram Izadi

[2015 CVWW] Hands Deep in Deep Learning for Hand Pose Estimation. [PDF] [Project Page] [Code]

Markus Oberweger, Paul Wohlhart, Vincent Lepetit

[2015 FG] Combining Discriminative and Model Based Approaches for Hand Pose Estimation. [PDF] [Project Page]

Philip Krejov, Andrew Gilbert, Richard Bowden

[2015 SGP] Robust Articulated-ICP for Real-Time Hand Tracking. [PDF] [Project Page] [Code]

Anastasia Tkach, Mark Pauly, Andrea Tagliasacchi

[back to top]

2014 CVPR

Realtime and robust hand tracking from depth. [PDF] [Project Page]

Chen Qian, Xiao Sun, Yichen Wei, Xiaoou Tang and Jian Sun

Latent regression forest: Structured estimation of 3d articulated hand posture. [PDF] [Project Page]

Danhang Tang, Hyung Jin Chang, Alykhan Tejani, T-K. Kim

User-specific hand modeling from monocular depth sequences. [PDF] [Project Page]

Jonathan Taylor, Richard Stebbing, Varun Ramakrishna, Cem Keskin, Jamie Shotton, Shahram Izadi, Aaron Hertzmann, Andrew Fitzgibbon

Evolutionary Quasi-random Search for Hand Articulations Tracking. [PDF] [Project Page]

Iason Oikonomidis, Manolis IA Lourakis, Antonis A Argyros

[back to top]

2014 Others & Before

[2014 SIGGRAPH] Real-Time Continuous Pose Recovery of Human Hands Using Convolutional Networks. [PDF] [Project Page]

Jonathan Tompson, Murphy Stein, Yann Lecun and Ken Perlin

[2013 ICCV] Real-time Articulated Hand Pose Estimation using Semi-supervised Transductive Regression Forests. [PDF] [Project Page]

Danhang Tang, Tsz Ho Yu and T-K. Kim

[2013 ICCV] Interactive Markerless Articulated Hand Motion Tracking Using RGB and Depth Data. [PDF] [Project Page]

Srinath Sridhar, Antti Oulasvirta, Christian Theobalt

[2013 ICCV] Efficient Hand Pose Estimation from a Single Depth Image. [PDF] [Project Page]

Chi Xu, Li Cheng

[2012 ECCV] Motion Capture of Hands in Action using Discriminative Salient Points. [PDF] [Project Page]

Ballan, L. and Taneja, A. and Gall, J. and van Gool, L. and Pollefeys, M.

[2012 ECCV] Hand pose estimation and hand shape classification using multi-layered randomized decision forests.

Cem KeskinFurkan, KıraçYunus Emre, KaraLale Akarun

[2011 CVPRW] Real Time Hand Pose Estimation using Depth Sensors. [PDF]

Cem Keskin, Furkan Kırac, Yunus Emre Kara, Lale Akarun

[2011 BMVC] Efficient Model-based 3D Tracking of Hand Articulations using Kinect. [PDF] [Project Page] [Code]

Iason Oikonomidis, Nikolaos Kyriazis, Antonis A. Argyros

[back to top]

Theses

[2018] Articulated Human Pose Estimation in Unconstrained Images and Videos. [PDF]

Umar Iqbal, University of Bonn

[2018] Real-Time Generative Hand Modeling and Tracking. [PDF]

Anastasia Tkach, EPFL

[2018] Recovery of the 3D Virtual Human: Monocular Estimation of 3D Shape and Pose with Data Driven Priors. [PDF] [Project Page]

Endri Dibra, ETH Zürich

[2017] Human Segmentation, Pose Estimation and Applications. [PDF] [Slides]

Meysam Madadi, Universitat Autònoma de Barcelonato

[2017] Capturing Hand-Object Interaction and Reconstruction of Manipulated Objects. [PDF] [Project Page]

Dimitrios Tzionas, University of Bonn

[2016] Tracking Hands in Action for Gesture-based Computer Input. [PDF]

Srinath Sridhar, Max Planck Institute for Informatics

[2016] 3D hand pose regression with variants of decision forests. [PDF] [Project Page]

Danhang Tang, Imperial College London

[2016] Deep Learning for Human Motion Analysis. [PDF] [Project Page]

Natalia Neverova, National Institut of Applied Science (INSA de Lyon), France

[2016] Real time hand pose estimation for human computer interaction. [PDF] [Project Page]

Philip Krejov, University of Surrey

[2015] Efficient Tracking of the 3D Articulated Motion of Human Hands. [PDF]

Iason Oikonomidis, University of Crete

[2015] Vision-based hand pose estimation and gesture recognition. [PDF]

Hui Liang, Nanyang Technological University

[2015] Localization of Humans in Images Using Convolutional Networks. [PDF]

Jonathan Tompson, New York University

[back to top]

Datasets

  • S/R: Synthetic (S) or Real (R) or Both (B)
  • C/D: Color (RGB) or Depth (D)
  • Obj: Interaction with objects or not
  • #J: No. of joints
  • V: view (3rd or egocentric)
  • #S: No. of subjects
  • #F: No. of frames (train/test)
Dataset Year S/R C/D Obj #J V #S #F Related Paper
NYU Hand Pose 2014 R D No 36 3rd 2 72k/8k Real-Time Continuous Pose Recovery of Human Hands Using Convolutional Networks, SIGGRAPH 2014 [PDF]
ICVL 2014 R D No 16 3rd 10 331k/1.5k Latent regression forest: Structured estimation of 3d articulated hand posture, CVPR 2014 [PDF]
MSRA15 2015 R D No 21 3rd 9 76,375 Cascaded Hand Pose Regression, CVPR 2015 [PDF]
BigHand2.2M 2017 R D No 21 3rd 10 2.2M Big Hand 2.2M Benchmark: Hand Pose Data Set and State of the Art Analysis, CVPR 2017 [PDF]
FHAD 2018 R D Yes 21 ego 6 100k First-Person Hand Action Benchmark with RGB-D Videos and 3D Hand Pose Annotations, CVPR 2018 [PDF]
GANerated Hands 2018 S C Both 21 ego - 330k GANerated Hands for Real-Time 3D Hand Tracking from Monocular RGB, CVPR 2018 [PDF]
EgoDexter 2017 R C+D Yes 5 ego 4 1485 Real-time Hand Tracking under Occlusion from an Egocentric RGB-D Sensor, ICCV 2017 [PDF]
SynthHands 2017 S C+D Both 21 ego 2 63,530 Real-time Hand Tracking under Occlusion from an Egocentric RGB-D Sensor, ICCV 2017 [PDF]
RHD 2017 S C+D No 21 3rd 20 41k/2.7k Learning to Estimate 3D Hand Pose from Single RGB Images, ICCV 2017 [PDF]
STB 2017 R C+D No 21 3rd 1 18k A Hand Pose Tracking Benchmark from Stereo Matching, ICIP 2017 [PDF]
CMU Panoptic HandDB 2017 B C No 21 3rd - 14,817 Hand Keypoint Detection in Single Images using Multiview Bootstrapping, CVPR 2017 [PDF]
Dexter+Object 2016 R C+D Yes 5 3rd 2 3,014 Real-time Joint Tracking of a Hand Manipulating an Object from RGB-D Input, ECCV 2016 [PDF]
MSRC (FingerPaint) 2015 S D No 21 both 1 100k Accurate, Robust, and Flexible Real-time Hand Tracking, CHI 2015 [PDF]
HandNet 2015 R D No 6 3rd 10 202k/10k Rule of Thumb: Deep Derotation for Improved Fingertip Detection, BMVC 2015 [PDF]
UCI-EGO 2014 R D+C No 26 ego 2 400 3D Hand Pose Detection in Egocentric RGB-D Images, ECCVW 2014 [PDF]
Hands in Action 2014 R D Yes - 3rd - - Capturing Hands in Action using Discriminative Salient Points and Physics Simulation, IJCV 2016 [PDF]
MSRA14 2014 R D No 21 3rd 6 2,400 Realtime and Robust Hand Tracking from Depth, CVPR 2014 [PDF]
Dexter1 2013 R D+C No 6 3rd 1 2,137 Interactive Markerless Articulated Hand Motion Tracking Using RGB and Depth Data, ICCV 2013 [PDF]
ASTAR 2013 R D No 20 3rd 30 870 Efficient hand pose estimation from a single depth image, ICCV 2013 [PDF]

Credits:

  • [1] Big Hand 2.2M Benchmark: Hand Pose Data Set and State of the Art Analysis, CVPR 2017 [PDF]
  • [2] Depth-based hand pose estimation: methods, data, and challenges, ICCV 2015 Link
  • [3] Capturing Hand-Object Interaction and Reconstruction of Manipulated Objects, IJCV 2016 [PDF]
  • [4] MPI Hand Tracking Central

[back to top]

Workshops

[1] Workshops on Observing and Understanding Hands in Action:

HANDS 2018, In conjunction with ECCV 2018
  • HANDS18: Methods, Techniques and Applications for Hand Observation. [PDF]
  • Iason Oikonomidis, Guillermo Garcia-Hernando, Angela Yao, Antonis Argyros, Vincent Lepetit, Tae-Kyun Kim
HANDS 2017, In conjunction with ICCV 2017
HANDS 2016, In conjunction with CVPR 2016
HANDS 2015, In conjunction with CVPR 2015

[2] Workshops on Capturing and modeling human bodies, faces and hands:

PeopleCap 2018, In conjunction with ECCV 2018
PeopleCap 2017, In conjunction with ICCV 2017

[back to top]

Challenges

The 2017 Hands in the Million Challenge on 3D Hand Pose Estimation

HANDS 2017, ICCV 2017

[back to top]

Other Related Papers

[2018 SIGGRAPH] Online Optical Marker-based Hand Tracking with Deep Labels. [PDF] [Code]

Shangchen Han, Beibei Liu, Robert Wang, Yuting Ye, Christopher D. Twigg, Kenrick Kin

[2018 CVPRW] HandyNet: A One-stop Solution to Detect, Segment, Localize & Analyze Driver Hands. [PDF]

Akshay Rangesh, Mohan M. Trivedi

[2018 CVPR] DensePose: Dense Human Pose Estimation In The Wild. [PDF] [Project Page] [Code]

Rıza Alp Güler, Natalia Neverova, Iasonas Kokkinos

[2018 CVPR] Analysis of Hand Segmentation in the Wild. [PDF] [Code]

Aisha Urooj Khan, Ali Borji

[2018 CVPR] Total Capture: A 3D Deformation Model for Tracking Faces, Hands, and Bodies. [PDF] [Project Page]

Hanbyul Joo, Tomas Simon, Yaser Sheikh

[2017 CVPR] SurfNet: Generating 3D shape surfaces using deep residual networks. [PDF]

Ayan Sinha, Asim Unmesh, Qixing Huang, Karthik Ramani

[2017 CVPR] Learning from Simulated and Unsupervised Images through Adversarial Training. [PDF] [Project Page] [Code-Tensorflow] [Code-Keras] [Code-Tensorflow-NYU-Hand]

Ashish Shrivastava, Tomas Pfister, Oncel Tuzel, Josh Susskind, Wenda Wang, Russ Webb

[2016 3DV] Learning to Navigate the Energy Landscape. [PDF] [Project Page]

Julien Valentin, Angela Dai, Matthias Niessner, Pushmeet Kohli, Philip H.S. Torr, Shahram Izadi

[2016 NIPS] DISCO Nets : Dissimilarity Coefficient Networks. [PDF] [Project Page] [Code]

Diane Bouchacourt, M. Pawan Kumar, Sebastian Nowozin

[2015 ICCV] 3D Object Reconstruction from Hand-Object Interactions. [PDF] [Project Page]

Dimitrios Tzionas and Juergen Gall

[back to top]


* indicates equal contribution