Real-time 3D pointing gesture recognition in mobile space

Park, Chang-Beom; Roh, Myung-Cheol; Lee, Seong–Whan

doi:10.1109/afgr.2008.4813448

Cited by 20 publications

(16 citation statements)

References 16 publications

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“…[33]- [35]) and estimating the referred-to target has been addressed by several authors in recent years, aiming at applications in robotics (e.g. [36]- [39]), smart environments (e.g.…”

Section: Related Workmentioning

confidence: 99%

Saliency-based identification and recognition of pointed-at objects

Schauerte

Richarz

Fink

2010

2010 IEEE/RSJ International Conference on Intelligent Robots and Systems

View full text Add to dashboard Cite

Abstract-When persons interact, non-verbal cues are used to direct the attention of persons towards objects of interest. Achieving joint attention this way is an important aspect of natural communication. Most importantly, it allows to couple verbal descriptions with the visual appearance of objects, if the referred-to object is non-verbally indicated. In this contribution, we present a system that utilizes bottom-up saliency and pointing gestures to efficiently identify pointed-at objects. Furthermore, the system focuses the visual attention by steering a pan-tilt-zoom camera towards the object of interest and thus provides a suitable model-view for SIFT-based recognition and learning. We demonstrate the practical applicability of the proposed system through experimental evaluation in different environments with multiple pointers and objects.

show abstract

“…[33]- [35]) and estimating the referred-to target has been addressed by several authors in recent years, aiming at applications in robotics (e.g. [36]- [39]), smart environments (e.g.…”

Section: Related Workmentioning

confidence: 99%

Saliency-based identification and recognition of pointed-at objects

Schauerte

Richarz

Fink

2010

2010 IEEE/RSJ International Conference on Intelligent Robots and Systems

View full text Add to dashboard Cite

show abstract

“…Skilled narrators may even use self-created hand movements in explaining directions to interlocutors, so the seemingly unproblematic notion of directions becomes sophisticated [13]. In this section, we aim to unravel this complexity in notion of directions and variety of performance in terms of pointing gesture.…”

Section: Pointing Gesture Detectionmentioning

confidence: 99%

“…In the literature, line of sight or head-hand line are widely used for pointing direction recognition [15,13,16]. However, these methods may fail in some situations where people cannot raise their arms in the same level as eyes or fully stretch their arms.…”

Section: Pointing Direction Recognitionmentioning

confidence: 99%

“…In terms of capturing human postures, three types of vision systems have been widely used, namely, Time of Flight (ToF) camera, stereo camera, and Kinect [11]. Researchers have also built various computational models for pointing gesture detection, such as active appearance model [12], cascade Hidden Markov Models (HMMs) [13], and parametric HMMs [14]. In order This work is submitted to the invited session entitled "Learning and Control in Human-Robot Interaction".…”

Section: Introductionmentioning

confidence: 99%

See 1 more Smart Citation

3D pointing gesture recognition for human-robot interaction

Lai

Wang

et al. 2016

2016 Chinese Control and Decision Conference (CCDC)

View full text Add to dashboard Cite

Abstract:In this paper, a pointing gesture recognition method is proposed for human-robot interaction. The pointing direction of the human partner is obtained by extracting the joint coordinates and computing through vector calculations. 3D to 2D mapping is implemented to build a top-view 2D map with respect to the actual ground circumstance. Using this method, robot is able to interpret the human partner's 3D pointing gesture based on the coordinate information of his/her shoulder and hand. Besides this, speed control of robot can be achieved by adjusting the position of the human partner's hand relative to the head. The recognition performance and viability of the system are tested through quantitative experiments.

show abstract

“…Motivated by recent advances in feature detection [28], [34]- [39], we propose a novel technique to estimate pointing direction based on two orthogonal-view cameras. Here, we only focus on the gesture of hand pointing.…”

Section: B Hand Detection and Trackingmentioning

confidence: 99%

A Multi-Gesture Interaction System Using a 3-D Iris Disk Model for Gaze Estimation and an Active Appearance Model for 3-D Hand Pointing

Reale

Canavan

Liu

et al. 2011

IEEE Trans. Multimedia

View full text Add to dashboard Cite

Abstract-In this paper, we present a vision-based human-computer interaction system, which integrates control components using multiple gestures, including eye gaze, head pose, hand pointing, and mouth motions. To track head, eye, and mouth movements, we present a two-camera system that detects the face from a fixed, wide-angle camera, estimates a rough location for the eye region using an eye detector based on topographic features, and directs another active pan-tilt-zoom camera to focus in on this eye region. We also propose a novel eye gaze estimation approach for point-of-regard (POR) tracking on a viewing screen. To allow for greater head pose freedom, we developed a new calibration approach to find the 3-D eyeball location, eyeball radius, and fovea position. Moreover, in order to get the optical axis, we create a 3-D iris disk by mapping both the iris center and iris contour points to the eyeball sphere. We then rotate the fovea accordingly and compute the final, visual axis gaze direction. This part of the system permits natural, non-intrusive, pose-invariant POR estimation from a distance without resorting to infrared or complex hardware setups. We also propose and integrate a two-camera hand pointing estimation algorithm for hand gesture tracking in 3-D from a distance. The algorithms of gaze pointing and hand finger pointing are evaluated individually, and the feasibility of the entire system is validated through two interactive information visualization applications.Index Terms-Gaze estimation, hand tracking, human-computer interaction (HCI).

show abstract

Real-time 3D pointing gesture recognition in mobile space

Cited by 20 publications

References 16 publications

Saliency-based identification and recognition of pointed-at objects

Saliency-based identification and recognition of pointed-at objects

3D pointing gesture recognition for human-robot interaction

A Multi-Gesture Interaction System Using a 3-D Iris Disk Model for Gaze Estimation and an Active Appearance Model for 3-D Hand Pointing

Contact Info

Product

Resources

About