A pervasive gesture-driven augmented reality prototype using wireless sensor body area networks

Abstract

This paper describes the prototype implementation of a pervasive, wearable augmented reality (AR) system based on a full bodymotion-capture system using low-power wireless sensors. The system uses body motion to visualize and interact with virtual objects populating AR settings. Body motion is used to implement a whole body gesture-driven interface to manipulate the virtual objects. Gestures are mapped to correspondent behaviors for virtual objects, such as controlling the playback and volume of virtual audio players or displaying a virtual object's metadata.

Body Area Networks in Healthcare: A Brief State of the Art

“…Data provided by these sensors are analyzed to assess, for instance, the physical ability of users, determining if a movement is properly executed, to know the speed reached, the amount of calories and fat burned, your heart rate, or the distance traveled in the exercise [4]. Moreover, BANs are also utilized in virtual and augmented reality to detect body movements or hand gestures to interact with objects within a virtual environment [38]. Another approach presents a wearable composed of three-axis absolute orientation sensor, accelerometer and gyroscope [39].…”

Interactive exploration of historic information via gesture recognition

“…Restrictive interaction has been shown to be detrimental to task performance, Barrie et al [4] attempted to design a system in which virtual objects can be manipulated in an augmented reality but results showed that the use of low powered wireless sensors (Figure 2.14) and headset became cumbersome and impractical. The system was restricted by the headset connections and also assumes that the user is fixed is space, meaning only the top half of the body is used to capture.…”

Mobile augmented reality

“…Augmented and mixed reality are concepts that have been used around technology for a few years [3] [5]. However, their coupling with mobile devices has only been made possible more recently with the advent of powerful smart-phones.…”

“…Moreover, as previous work has shown, augmented reality provides new affordances and visualization options that enhance experiences by providing additional information combined with the real world surroundings of the users [2][3][5] [8]. By placing virtual objects or feedback over reality users are provided access to information that is typically not available to them using their own senses [3]. Naturally, this gains further relevance with mobile technology as users move around and are able to explore what is around them freely within real world settings [1] [5].…”

“…A growing trend that is increasingly combining function and usefulness to mobility and enticing user experiences is augmented reality (AR). Unlike initial experiments [3] [2] where a significant amount of equipment was necessary to create mobile AR applications, current smart-phones can easily support this type of experience in real world settings. In addition, making use of the available GPS and integrated compasses, the combination of AR and location-enabled and positioning services [7] [8] is gradually providing users with ways to use AR to easily access information about their surroundings on the go.…”