Real-time 3D hand shape estimation based on image feature analysis and inverse kinematics

Weiying Chen, Ryuji Fujikit, Daisaku Arita, Rin-Ichiro Taniguchi

Research output: Chapter in Book/Report/Conference proceedingConference contribution

5 Citations (Scopus)

Abstract

Vision-based hand shape estimation is a challenging task, since the hand presents a motion of high degrees of freedom and since self-occlusions of different fingers bring a lot of uncertainty for the occluded parts. Considering that the influence of self-occlusions may be reduced by observing multiple images, we propose a multiple view system to obtain hand features, with using previous information that facilitates very robust feature extraction. The extracted features are then used to compute approximate global state of hand and perform preliminary estimation of the local state of each finger by Inverse Kinematics (IK). By minimizing the estimation error between groups of model features and groups of image features, some model parameters are refined and IK is recomputed, which contributes to enhance estimation accuracy. To reduce the estimation complexity due to the high degrees of freedom of the hand, we combine IK with the motion constraints of articulated hand. The effectiveness of our approach is demonstrated with experiments on a number of different hand motions with finger articulation and global hand rotation under complex background.

Original languageEnglish
Title of host publicationProceedings - 14th International Conference on Image Analysis and Processing, ICIAP 2007
Pages247-252
Number of pages6
DOIs
Publication statusPublished - Dec 1 2007
Event14th Edition of the International Conference on Image Analysis and Processing, ICIAP 2007 - Modena, Italy
Duration: Sep 10 2007Sep 14 2007

Other

Other14th Edition of the International Conference on Image Analysis and Processing, ICIAP 2007
CountryItaly
CityModena
Period9/10/079/14/07

Fingerprint

Inverse kinematics
Error analysis
Feature extraction
Experiments

All Science Journal Classification (ASJC) codes

  • Computer Vision and Pattern Recognition

Cite this

Chen, W., Fujikit, R., Arita, D., & Taniguchi, R-I. (2007). Real-time 3D hand shape estimation based on image feature analysis and inverse kinematics. In Proceedings - 14th International Conference on Image Analysis and Processing, ICIAP 2007 (pp. 247-252). [4362787] https://doi.org/10.1109/ICIAP.2007.4362787

Real-time 3D hand shape estimation based on image feature analysis and inverse kinematics. / Chen, Weiying; Fujikit, Ryuji; Arita, Daisaku; Taniguchi, Rin-Ichiro.

Proceedings - 14th International Conference on Image Analysis and Processing, ICIAP 2007. 2007. p. 247-252 4362787.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Chen, W, Fujikit, R, Arita, D & Taniguchi, R-I 2007, Real-time 3D hand shape estimation based on image feature analysis and inverse kinematics. in Proceedings - 14th International Conference on Image Analysis and Processing, ICIAP 2007., 4362787, pp. 247-252, 14th Edition of the International Conference on Image Analysis and Processing, ICIAP 2007, Modena, Italy, 9/10/07. https://doi.org/10.1109/ICIAP.2007.4362787
Chen W, Fujikit R, Arita D, Taniguchi R-I. Real-time 3D hand shape estimation based on image feature analysis and inverse kinematics. In Proceedings - 14th International Conference on Image Analysis and Processing, ICIAP 2007. 2007. p. 247-252. 4362787 https://doi.org/10.1109/ICIAP.2007.4362787
Chen, Weiying ; Fujikit, Ryuji ; Arita, Daisaku ; Taniguchi, Rin-Ichiro. / Real-time 3D hand shape estimation based on image feature analysis and inverse kinematics. Proceedings - 14th International Conference on Image Analysis and Processing, ICIAP 2007. 2007. pp. 247-252
@inproceedings{1b16717efbc1469d9562a6eefb4c8553,
title = "Real-time 3D hand shape estimation based on image feature analysis and inverse kinematics",
abstract = "Vision-based hand shape estimation is a challenging task, since the hand presents a motion of high degrees of freedom and since self-occlusions of different fingers bring a lot of uncertainty for the occluded parts. Considering that the influence of self-occlusions may be reduced by observing multiple images, we propose a multiple view system to obtain hand features, with using previous information that facilitates very robust feature extraction. The extracted features are then used to compute approximate global state of hand and perform preliminary estimation of the local state of each finger by Inverse Kinematics (IK). By minimizing the estimation error between groups of model features and groups of image features, some model parameters are refined and IK is recomputed, which contributes to enhance estimation accuracy. To reduce the estimation complexity due to the high degrees of freedom of the hand, we combine IK with the motion constraints of articulated hand. The effectiveness of our approach is demonstrated with experiments on a number of different hand motions with finger articulation and global hand rotation under complex background.",
author = "Weiying Chen and Ryuji Fujikit and Daisaku Arita and Rin-Ichiro Taniguchi",
year = "2007",
month = "12",
day = "1",
doi = "10.1109/ICIAP.2007.4362787",
language = "English",
isbn = "0769528775",
pages = "247--252",
booktitle = "Proceedings - 14th International Conference on Image Analysis and Processing, ICIAP 2007",

}

TY - GEN

T1 - Real-time 3D hand shape estimation based on image feature analysis and inverse kinematics

AU - Chen, Weiying

AU - Fujikit, Ryuji

AU - Arita, Daisaku

AU - Taniguchi, Rin-Ichiro

PY - 2007/12/1

Y1 - 2007/12/1

N2 - Vision-based hand shape estimation is a challenging task, since the hand presents a motion of high degrees of freedom and since self-occlusions of different fingers bring a lot of uncertainty for the occluded parts. Considering that the influence of self-occlusions may be reduced by observing multiple images, we propose a multiple view system to obtain hand features, with using previous information that facilitates very robust feature extraction. The extracted features are then used to compute approximate global state of hand and perform preliminary estimation of the local state of each finger by Inverse Kinematics (IK). By minimizing the estimation error between groups of model features and groups of image features, some model parameters are refined and IK is recomputed, which contributes to enhance estimation accuracy. To reduce the estimation complexity due to the high degrees of freedom of the hand, we combine IK with the motion constraints of articulated hand. The effectiveness of our approach is demonstrated with experiments on a number of different hand motions with finger articulation and global hand rotation under complex background.

AB - Vision-based hand shape estimation is a challenging task, since the hand presents a motion of high degrees of freedom and since self-occlusions of different fingers bring a lot of uncertainty for the occluded parts. Considering that the influence of self-occlusions may be reduced by observing multiple images, we propose a multiple view system to obtain hand features, with using previous information that facilitates very robust feature extraction. The extracted features are then used to compute approximate global state of hand and perform preliminary estimation of the local state of each finger by Inverse Kinematics (IK). By minimizing the estimation error between groups of model features and groups of image features, some model parameters are refined and IK is recomputed, which contributes to enhance estimation accuracy. To reduce the estimation complexity due to the high degrees of freedom of the hand, we combine IK with the motion constraints of articulated hand. The effectiveness of our approach is demonstrated with experiments on a number of different hand motions with finger articulation and global hand rotation under complex background.

UR - http://www.scopus.com/inward/record.url?scp=48149095027&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=48149095027&partnerID=8YFLogxK

U2 - 10.1109/ICIAP.2007.4362787

DO - 10.1109/ICIAP.2007.4362787

M3 - Conference contribution

AN - SCOPUS:48149095027

SN - 0769528775

SN - 9780769528779

SP - 247

EP - 252

BT - Proceedings - 14th International Conference on Image Analysis and Processing, ICIAP 2007

ER -