We present a prototype demonstrator that integrates three technologies: mixed reality head mounted displays, wearable biosensors, and mid-air haptic projectors to deliver an interactive tactile experience with a bio-hologram. Users of this prototype are able to see, touch and feel a hologram of a heart that is beating at the same rhythm as their own. The demo uses an Ultrahaptics device, a Magic Leap One Mixed Reality headset, and an Apple Watch that measures the wearer's heart rate, all synchronized and networked together such that updates from the wristband dynamically change the haptic feedback and the animation speed of the beating heart thus creating a more personalised experience.
Haptic devices have often been used to enhance a variety of audio experiences such as listening to music, meditating, wayfinding, accessibility, and communicating. In most cases, the haptic interface is wearable or handheld and therefore suffers from limitations related to ergonomics or a limited palette of haptic sensation effects. In this paper, we present a touchless audio-haptic demonstrator experience that enhances the immersive narrative of an emotional short story. To do so, we have created an audio-haptic mapping that is semantically congruent and have synchronized the presentation of audio and haptic effects to the narrative timeline. The haptic effects presented to the user's palm are both spatially and temporally modulated so that they convey a rich palette of sensations (e.g., tapping, direction, rotation, rain, electricity, etc.) that are triggered by keywords or events in the story.
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.