Gesture control interface for immersive panoramic displays

Abstract

In this paper, we propose a gesture-based interface designed to interact with panoramic scenes. The system combines novel static gestures with a fast hand tracking method. Our proposal is to use static gestures as shortcuts to activate functionalities of the system (i.e. volume up/down, mute, pause, etc.), and hand tracking to freely explore the panoramic video. The overall system is multi-user, and incorporates a user identification module based on face recognition, which is able both to recognize returning users and to add new users online. The system exploits depth data, making it robust to challenging illumination conditions. We show through experimental results the performance of every component of the system compared to the state of the art. We also show the results of a usability study performed with several untrained users.

The Comparison and Analysis of Several Common VR Panoramic Display Methods

“…VR panoramic display technology is accompanied by the development of computer technology, combining digital media technology, graphic image technology, network technology, multimedia technology, sensing technology and other information technologies, emphasizing visual reality, panoramic viewing and immersive interactive experience [3]. The technology of panoramic display experience has experienced technical stages such as single view panorama, strip panorama and immersive panorama.…”

Screen-Printed Washable Electronic Textiles as Self-Powered Touch/Gesture Tribo-Sensors for Intelligent Human–Machine Interaction

“…However, these processing methods can hardly meet the requirements of washability, pattern diversity, and time-efficient/mass production of the electrode. On the other hand, smart systems for touch/gesture sensing are crucial for human–machine interfaces. , The realization of gesture control through E-textiles requires highly integrated sensors, which sets higher requirements for the formation of electrode patterns. Furthermore, the development of such E-textiles is also shadowed by its power supply as a traditional battery is a burden for light, convenient E-textiles …”

Woven Wearable Electronic Textiles as Self‐Powered Intelligent Tribo‐Sensors for Activity Monitoring

“…Furthermore, wearable electronics still remain great challenges in terms of air permeability, flexibility, and light weight . On the other hand, smart touch‐sensing systems are crucial for human‐interactive interfaces . Although artificial skin sensors have the advantages of high sensitivity and shape‐adaptivity, they need great improvement on skin‐friendly and comfortability …”