Leap Motion Sensor for Natural User Interface

Abstract

In Human Computer Interaction (HCI) research area, there is an increasing tendency to make devices as simple and as natural as possible for use. These devices are aiming to make input and output techniques, interaction, etc., easier. In the input domain, sensors monitor and interpret head, eye, face and even whole body movements. Interacting with the computer, hands are the most effective tool of general purpose, due to their functionality in communication and manipulation. Using hands as an input device is an attractive method for ensuring interaction between man and computer. This paper gives an overview of the Leap Motion devices as a technology that enables natural interaction between man and computer in NUI (natural user interface) implementation. The main idea to maximize the naturalness of the user environment and the use of hand movements is in the application of the sensor fusion of two Leap Motion devices. Applying sensor fusion of two Leap Motion devices will increase the range of hand movement and the interaction within the environment, which will again contribute to the natural user interface (NUI). The suggested method can be used offline or in real time, and can benefit from a wide range of applications, where the gesture of the hand and fingers is the focus of significance and estimation effect.

Interacciones basadas en gestos: revisión crítica

“…La revisión presentada en este artículo parte del interés en desarrollar métodos y herramientas de interacción entre las personas y los computadores, en los que la frontera entre lo material -objetos, ambiente, sujetos-y lo inmaterial -bits, datos, representaciones abstractas-sea difusa. Con frecuencia este tipo de interacciones son referidas en áreas de HCI como interfaces tangibles de usuario [17], [18], interfaces orgánicas (OUI) [19] o interfaces naturales de usuario (NUI) [20].…”

“…En ambos casos, la comprensión del gesto es muy amplia y aplica para diferentes partes del cuerpo: estos faciales [33], con las manos [5], [34], [35], con los dedos [4], [5], [20], o de cuerpo entero [8], [36]. En algunos casos, la complejidad técnica de reconocer la secuencia de acciones que definen un gesto ha llevado a que se utilicen objetos que restrinjan la interacción [11], [18].…”