A Long-Range Touch Interface for Interaction with Smart TVs

Abstract

A powerful interaction mechanism is one of the key elements for the success of smart TVs, which demand far more complex interactions than traditional TVs. This paper proposes a novel interface based on the famous touch interaction model but utilizes long-range bare hand tracking to emulate touch actions. To satisfy the essential requirements of high accuracy and immediate response, the proposed hand tracking algorithm adopts a fast colorbased tracker but with modifications to avoid the problems inherent to those algorithms. By using online modeling and motion information, the sensitivity to the environment can be greatly decreased. Furthermore, several ideas to solve the problems often encountered by users interacting with smart TVs are proposed, resulting in a very robust hand tracking algorithm that works superbly, even for users with sleeveless clothing. In addition, the proposed algorithm runs at a very high speed of 82.73 Hz. The proposed interface is confirmed to comfortably support most touch operations, such as clicks, swipes, and drags, at a distance of three meters, which makes the proposed interface a good candidate for interaction with smart TVs. Keywords: Smart TV, touch interface, bare hand tracking, human computer interaction. Manuscript received Oct. 19, 2011; revised Aug. 14, 2012; accepted Aug. 22, 2012. Jaeyeon Lee (phone: +82 42 860 5507, leejy@etri.re.kr), DoHyung Kim (dhkim008@etri.re.kr), Jaehong Kim (jhkim504@etri.re.kr ), Jae-il Cho (jicho@etri.re.kr), and Joochan Sohn (jcsohn@etri.re.kr) are with the IT Convergence Technology Research Laboratory, ETRI, Daejeon, Rep. of Korea.http://dx

Interactive interface on a sports simulator for improved interaction and personalized services

“…It is important to enhance the feeling of intimacy for the user. The user will want to communicate naturally using gestures or motions of their body [4][5]. In this connection a number of related studies are being carried in various field of industry.…”

Interaction control for postural correction on a riding simulation system

“…When a simulation is used to achieve learning objectives, its interactive interface needs to be carefully designed [2][3][4]. In particular, it is important to enhance the feeling of intimacy for the user, who may want to communicate naturally using bodily gestures or motions [5][6]. In this connection, a number of related studies are being carried in various fields of industry.…”

High‐Quality Stereo Depth Map Generation Using Infrared Pattern Projection

“…Research on obtaining 3D depth information has constantly progressed in the computer vision field owing to the various types of applicability and importance, for example, a humancomputer interface (HCI) [1], human-robot interaction, surveillance [2], and 3D reconstruction.…”