Tangible Around-Device Interaction Using Rotatory Gestures with a Magnetic Ring

Abstract

The majority of mobile applications use built-in touchscreens and/or accelerometers to provide direct ways for user inputs. Yet, the need to manipulate the device itself (e.g. touch, tilt) poses usability issues such as occlusion and inaccuracy. To address these issues, research proposed using the built-in magnetometer and magnets to facilitate around-device interactions. However, there is little evaluation in how this technique impacts performance and user experience beyond simple docking tasks. To fll this gap, we explored the mobile gameplay context by implementing an interface that uses rotatory gestures from a magnetic ring as input, and compared two control mappings (angular and linear) with touch and tilt in a usability study using a mobile game. We found that rotatory gestures with the ring, when mapped to angular controls, were on par with touch and superior over tilt, and engendered greater gameplay experience and sense of mapping. Based on our fndings, we discuss implications of using this technique for gameplay, as well as other applications.

SensorMov, biblioteca nativa para interacciones tangibles con dispositivos Android

“…El segundo es VibroComm en el que usan el giroscopio del celular para interpretar datos acústicos para compartir información o efectuar pagos de manera segura [28]. Además, el experimento "Tangible Around-Device Interaction Using Rotatory Gestures with a Magnetic Ring" que propone nuevas formas de jugar un videojuego al usar una argolla y el magnetómetro del dispositivo como principal control de un juego de naves [7]. Adicionalmente, el artículo "A survey of patterns for adapting smartphone app UIs to smartwatches" presenta una revisión del uso de sensores externos, como los de los relojes inteligentes, para transmitir su información a dispositivos móviles, y así extender sus funcionalidades [29].…”

“…Los otros sensores disponibles en los dispositivos móviles son desaprovechados, e incluso pasados por alto, aun cuando podrían usarse para diversificar las formas de comunicación con la información digital que representan, a través de gestos e interfaces tangibles de usuario [6]. Los celulares no son directamente interfaces tangibles, pero sus múltiples características permiten su creación y uso en diferentes ámbitos, como en el entretenimiento [7]. Así mismo, permiten optimizar tareas mediante diferentes gestos [8].…”

Mixels: Fabricating Interfaces using Programmable Magnetic Pixels

“…GaussStones [18], and Geckos [15] employ a magnetometer to detect the states of physical inputs and positions of magnetic tangible tokens. Similarly, MagGetz [9], MagnID [6], GaussBricks [16], Gauss-Marbles [12], Magnetic Ring [8], MagneTrack [2] also demonstrate various applications including interactive games and input controls. By combining these sensing approaches with interactive touch displays, these systems allow users to manipulate and interact with digital information via the magnetic tangibles.…”

Comparison of Manual, Automatic, and Voice Control in Wheelchair NavigationSimulation in Virtual Environments: Performance Evaluation of User and MotionSickness.

“…Models transcribe speech into text or actions, allowing users to interact with technology through voice instead of typing or touch interfaces [23]. Currently, this option is being implemented in devices such as smartphones with voice assistants, tablets, smart speakers (Alexa, Siri, Google) [24], and even virtual games like "Scream Go Hero" [25], where the main character moves based on the player's verbal commands. This type of control is advantageous as it allows users to interact with devices remotely without physical contact, although a quiet environment is required.…”