Facilitating peripheral interaction: design and evaluation of peripheral interaction for a gesture-based lighting control with multimodal feedback

Abstract

Most interactions with today's interfaces require a person's full and focused attention. To alleviate the potential clutter of focal information, we investigated how interactions could be designed to take place in the background or periphery of attention. This paper explores whether gestural, multimodal interaction styles of an interactive light system allow for this. A study compared the performance of interactions with the light system in two conditions: the central condition in which participants interacted only with the light system, and the peripheral condition in which they interacted with the system while performing a high-attentional task simultaneously. Our study furthermore compared different feedback styles (visual, auditory, haptic, and a combination). Results indicated that especially for the combination feedback style, the interaction could take place without participants' full visual attention, and performance did not significantly decrease in the peripheral condition. This seems to indicate that these interactions at least partly took place in their periphery of attention and that the multimodal feedback style aided this process.

Novel Multimodal Feedback Techniques for In-Car Mid-Air Gesture Interaction

“…Visual attention is a measure used in driving studies [24,11,33] to evaluate the amount of distraction caused by secondary tasks. Liang et al [19] have shown that duration of glances reliably predicts the risk of crashes.…”

Tactual Articulatory Feedback on Gestural Input

“…One example is a gestural light controller, based on a laser pointer, and a light sensor mounted on the lamp to identify when the lamp was addressed, inside a small handheld unit which contained various sensors and actuators. The research project looked at ambient or peripheral interaction, and participants were tested in a controlled study with varying feedback modalities (visual, auditory, and haptic) to show that they were able to control light levels accurately as a peripheral task when occupied in a focal task simultaneously, significantly better (increased speed and accuracy of the interaction) with the multimodal confirmation and articulatory feedback (Heijboer et al 2016).…”

Prototipo de interfaz humano-computadora controlada a través de gestos faciales

“…Heijboer et, al. [7] resaltaron que el puntero de luz es un dispositivo adecuado para estudiar la viabilidad de las interacciones periféricas con una interfaz gestual. El objetivo de este experimento exploratorio fue rediseñar los estilos de interacción del puntero de luz de tal manera que potencialmente podría interactuar con la periferia de la atención.…”