Exploration of Ideal Interaction Scheme on Smart TV: Based on User Experience Research of Far-Field Speech and Mid-air Gesture Interaction

Li, Xuan; Guan, Daisong; Zhang, Jingya; Xingtong, Liu; Si-qi, LI; Tong, Hui

doi:10.1007/978-3-030-23541-3_12

Cited by 3 publications

(1 citation statement)

References 10 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Dawar and Kehtarnavaz [28] present a real-time detection and recognition approach to identify actions of interest involved in the smart TV application from continuous action streams via simultaneous utilization of a depth camera and a wearable inertial sensor. Li et al [29] propose the design principles of multichannel interaction fusion on Smart TV based on user experience research of far-field speech and mid-air gesture interaction. These works require the user to hold his arm and hand in mid-air for a certain period of time each time, which people find somewhat uncomfortable and tiring.…”

Section: Related Workmentioning

confidence: 99%

A Novel Human-3DTV Interaction System Based on Free Hand Gestures and a Touch-Based Virtual Interface

Zhang

2019

IEEE Access

View full text Add to dashboard Cite

The input method based on free-hand gestures has gradually become a hot research direction in the field of human-computer interaction. Hand gestures like sign languages, however, demand quite a lot of knowledge and practice for interaction, and air writing methods require their users to hold the arm and hand in mid-air for a period of time. These methods limit the user experience and get severer when a large number of gestures are required. To address the problem, this paper presents a novel human-3DTV interaction system based on a set of simple free-hand gestures for direct-touch interaction with a virtual interface to facilitate human-3DTV interaction. Specifically, our system projects a virtual interface in front of the user who wears the 3D shutter glass, and the user just stretches the arm and touches the virtual interface like performing on a smart phone with a touch screen, using gestures such as Click, Slide, Hold, Drag and Zoom In/Out. Our system is able to recognize the user's gesture fast and accurately, as the system only needs to search for a small region neighboring the virtual interface for a small set of gesture types. Because we adopt the key gestures using on smart phones, our free-hand gestures can be easily used by anyone with only a brief training. The users feel more comfortable than traditional gesture input methods and can effectively interact with 3DTV using our system. We report a comprehensive user study on accuracy and speed to validate the advantages of the proposed human-3DTV interaction system.

show abstract

Section: Related Workmentioning

confidence: 99%