Laser scanner based foot motion detection for intuitive robot user interface system

Seo, Jongwon; Yang, Jeong-Yean; Kwon, Dong‐Soo

doi:10.1109/roman.2012.6343750

Cited by 4 publications

(2 citation statements)

References 8 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Request permissions from permissions@acm.org. MM ' blink [3] and foot based interaction [10] etc. Handheld devices (such as smart phones) are equipped with advance signal processing techniques and improved hardware, making real-time fusion of data and multimodal interaction possible.…”

Section: Introductionmentioning

confidence: 99%

Hand and foot gesture interaction for handheld devices

Lü¹,

Khan

Réhman

2013

Proceedings of the 21st ACM International Conference on Multimedia

View full text Add to dashboard Cite

In this paper we present hand and foot based immersive multimodal interaction approach for handheld devices. A smart phone based immersive football game is designed as a proof of concept. Our proposed method combines input modalities (i.e. hand & foot) and provides a coordinated output to both modalities along with audio and video. In this work, human foot gesture is detected and tracked using template matching method and Tracking-Learning-Detection (TLD) framework. We evaluated our system's usability through a user study in which we asked participants to evaluate proposed interaction method. Our preliminary evaluation demonstrates the efficiency and ease of use of proposed multimodal interaction approach.

show abstract

Section: Introductionmentioning

confidence: 99%

Hand and foot gesture interaction for handheld devices

Lü¹,

Khan

Réhman

2013

Proceedings of the 21st ACM International Conference on Multimedia

View full text Add to dashboard Cite

show abstract

“…The system can detect the nearby users and guide them by projecting moving directions onto the floor. In 2012, Ju-Hwan Seo et al [48] developed a similar robotic platform to interact with a human by using a system that consists of a beam projector and a laser scanner. While the projector generates images on the floor, the laser scanner data is processed to recognize user's foot motion to determine user input 's commands.…”

Section: Indirect Interaction Interfacementioning

confidence: 99%

A new interaction framework for human and robot

Dinh¹

View full text Add to dashboard Cite

First and foremost, I would like to give my special thanks to Professor Seet Gim Lee, Gerald, my supervisor, for your generous support during all these years, for your mentoring, for the experienced guidance, academic supports, patience and valuable advices you have given during my research journey so far, especially for helping me find a way back at the time of being distracted from my research duty. I could not have imagined having a better advisor for my Ph.D study.I want to deeply grateful to Dr. Viatcheslav V Iastrebov for his enthusiastic cooperation and suggestions over the last 4 years when we implemented our project together. My work would have not been possible without your knowledge and experience. Furthermore, you are always a close friend to me and share many funny stories with me during my stay at RRC. I also would like to give big thanks to all my colleagues in Robotics Research Center: Wee Ching, Burhan, Hendra, Choon Yue, William, and Ahmad. You guys are always so nice to me since the first day I came to NTU. I especially wish to thank Ms. Wee Ching for sharing her knowledge and expertise at the beginning phase of my PhD project. I wish to show my great gratitude to my families. Without their unconditional supports and encouragements in moments of difficulties, I would not have been able to accomplish this result. Finally, I would love to specially thank my girlfriend, Ms.

show abstract

Multimodal Hand and Foot Gesture Interaction for Handheld Devices

Halawani

Feng

et al. 2014

ACM Trans. Multimedia Comput. Commun. Appl.

180

View full text Add to dashboard Cite

We present a hand-and-foot-based multimodal interaction approach for handheld devices. Our method combines input modalities (i.e., hand and foot) and provides a coordinated output to both modalities along with audio and video. Human foot gesture is detected and tracked using contour-based template detection (CTD) and Tracking-Learning-Detection (TLD) algorithm. 3D foot pose is estimated from passive homography matrix of the camera. 3D stereoscopic and vibrotactile are used to enhance the immersive feeling. We developed a multimodal football game based on the multimodal approach as a proof-of-concept. We confirm our systems user satisfaction through a user study.

show abstract

Laser scanner based foot motion detection for intuitive robot user interface system

Cited by 4 publications

References 8 publications

Hand and foot gesture interaction for handheld devices

Hand and foot gesture interaction for handheld devices

A new interaction framework for human and robot

Multimodal Hand and Foot Gesture Interaction for Handheld Devices

Contact Info

Product

Resources

About