Experiencing real 3D gestural interaction with mobile devices

Yousefi, Shahrouz; Kondori, Farid Abedan; Li, Haibo

doi:10.1016/j.patrec.2013.02.004

Cited by 11 publications

(6 citation statements)

References 24 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…The problems with direct-touch finger input are 'the occlusion problem' and 'the fat finger problem' [29]. Touch-less interaction extends the operation space resolution at least 5-10 times higher than 2D touch for interacting with mobiles [30] and helps mitigate the problems of using mobile phone while user's hands are not available, for instance, their hands are dirty, or they are wearing gloves in winter, or they are driving and holding the steering wheel [3], so that improving safely in contexts where switching visual attention between the device and the physical environment pose safety concerns, because touchless interaction doesn't require the user to manipulate any In addition, another motivation frequently mentioned is that touch-less interactions support more gestures in more natural patterns, which provide the less device-centric interaction techniques allowing a mobile user to focus attention on the task and its content instead of on the device while on the move. In this paper we explore and prototype a novel alternative touch-less approach to mobile interaction that uses a body-worn (i.e.…”

Section: Introductionmentioning

confidence: 99%

Wearable Smartphone: Wearable Hybrid Framework for Hand and Foot Gesture Interaction on Smartphone

2013

2013 IEEE International Conference on Computer Vision Workshops

View full text Add to dashboard Cite

There is a increasing interest in creating wearable smartphone interaction technologies. A novel smartphone wearable hybrid interaction framework based on mixed low-cost hardware and software is proposed in this work. The software application renders touch-less application graphics and status information using smart phone's screen. Augmented reality image rendering technology is employed for a convenient hand/foot and phone interaction. The users interact with the application using hand/foot gesture motion behind the camera, which trigger the interaction event and generate activity sequences for interactive buffers. The touch-less algorithm provides a core support for hand/foot-gesture interaction by accurately detecting and tracking the hand/foot gesture. Four proof-of-concept application prototypes are developed based on the wearable hybrid framework. The user study evaluation demonstrates the social acceptability of the designed hand/foot gestures and the usability of the applications on proposed wearable hybrid framework with touch-less interaction approach.

show abstract

Section: Introductionmentioning

confidence: 99%

Wearable Smartphone: Wearable Hybrid Framework for Hand and Foot Gesture Interaction on Smartphone

2013

2013 IEEE International Conference on Computer Vision Workshops

View full text Add to dashboard Cite

show abstract

“…In order to compare the effects of the augmented reality rendering interaction UI and pure graphic UI, a 'smile face' button at the right-top of the screen is developed to trigger hide/show status of the camera view, as in Figure 11. The stereoscopic 3D part is time consuming running on today's ordinary smartphone hardware, and the low performance will affect user experience [Yousefi et al 2013]. Therefore we didn't combine it in the proof-of-concept football game although we implement it on smartphone as a standalone.…”

Section: Multimodal Football Game -A Proof Of Conceptmentioning

confidence: 99%

Multimodal Hand and Foot Gesture Interaction for Handheld Devices

Halawani

Feng

et al. 2014

ACM Trans. Multimedia Comput. Commun. Appl.

Self Cite

180

View full text Add to dashboard Cite

We present a hand-and-foot-based multimodal interaction approach for handheld devices. Our method combines input modalities (i.e., hand and foot) and provides a coordinated output to both modalities along with audio and video. Human foot gesture is detected and tracked using contour-based template detection (CTD) and Tracking-Learning-Detection (TLD) algorithm. 3D foot pose is estimated from passive homography matrix of the camera. 3D stereoscopic and vibrotactile are used to enhance the immersive feeling. We developed a multimodal football game based on the multimodal approach as a proof-of-concept. We confirm our systems user satisfaction through a user study.

show abstract

“…However, to enable gesture-based 3D object manipulation, 27 DOF hand pose recovery is not necessarily needed. As a matter of fact, six motion parameters are sufficient to move and manipulate a graphical model in virtual/augmented reality applications (Yousefi et al, 2013). These six parameters, i.e.…”

Section: Novel Approachmentioning

confidence: 99%

“…In this experiment, grab gesture is used for object manipulation. The grab gesture is one of the most natural and frequently used gestures to manipulate objects in 3D space, and has been used to perform gesture-based interaction for mobile applications (Kondori et al, 2011a) (Yousefi et al, 2013). As shown in Fig.…”

Section: Gestural Interaction For Mobile Applicationsmentioning

confidence: 99%