Real-time 3D hand shape estimation based on image feature analysis and inverse kinematics

Weiying Chen, Ryuji Fujikit, Daisaku Arita, Rin-Ichiro Taniguchi

Research output: Chapter in Book/Report/Conference proceedingConference contribution

5 Citations (Scopus)

Abstract

Vision-based hand shape estimation is a challenging task, since the hand presents a motion of high degrees of freedom and since self-occlusions of different fingers bring a lot of uncertainty for the occluded parts. Considering that the influence of self-occlusions may be reduced by observing multiple images, we propose a multiple view system to obtain hand features, with using previous information that facilitates very robust feature extraction. The extracted features are then used to compute approximate global state of hand and perform preliminary estimation of the local state of each finger by Inverse Kinematics (IK). By minimizing the estimation error between groups of model features and groups of image features, some model parameters are refined and IK is recomputed, which contributes to enhance estimation accuracy. To reduce the estimation complexity due to the high degrees of freedom of the hand, we combine IK with the motion constraints of articulated hand. The effectiveness of our approach is demonstrated with experiments on a number of different hand motions with finger articulation and global hand rotation under complex background.

Original languageEnglish
Title of host publicationProceedings - 14th International Conference on Image Analysis and Processing, ICIAP 2007
Pages247-252
Number of pages6
DOIs
Publication statusPublished - Dec 1 2007
Event14th Edition of the International Conference on Image Analysis and Processing, ICIAP 2007 - Modena, Italy
Duration: Sep 10 2007Sep 14 2007

Other

Other14th Edition of the International Conference on Image Analysis and Processing, ICIAP 2007
CountryItaly
CityModena
Period9/10/079/14/07

All Science Journal Classification (ASJC) codes

  • Computer Vision and Pattern Recognition

Fingerprint Dive into the research topics of 'Real-time 3D hand shape estimation based on image feature analysis and inverse kinematics'. Together they form a unique fingerprint.

  • Cite this

    Chen, W., Fujikit, R., Arita, D., & Taniguchi, R-I. (2007). Real-time 3D hand shape estimation based on image feature analysis and inverse kinematics. In Proceedings - 14th International Conference on Image Analysis and Processing, ICIAP 2007 (pp. 247-252). [4362787] https://doi.org/10.1109/ICIAP.2007.4362787