Gesture-driven Interactions on a Virtual Hologram in Mixed Reality

Yim, Dianna; Loison, Garance Nicole; Fard, Fatemeh H.; Chan, Edwin Sy; McAllister, Alec; Maurer, Frank

doi:10.1145/3009939.3009948

Cited by 13 publications

(11 citation statements)

References 7 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…3D interaction with virtual objects has recently become an active research field in Human Computer Interaction and Computer Graphics, with the introduction of 3D interaction systems [15,31,38,42] and vast improvements of VR technologies over the last couple of years [1,3,4,16,17,20,21,27,33,45,50].…”

Section: Related Workmentioning

confidence: 99%

“…A frequent and simple type of hand interaction methods relies on kinematic-and gesturebased interfaces, where a predefined set of gestures is used to perform certain assigned actions. Common gestures include circle, swipe, pinch, screen tap, and key tap gestures [6,7,45]. A pinch detection is often used for detecting intended grasp interactions [25].…”

Section: Related Workmentioning

confidence: 99%

“…A pinch detection is often used for detecting intended grasp interactions [25]. One popular example of such a gesture-based interface is the Microsoft HoloLens [1,45]. A few predefined hand gestures are detected in real-time to trigger certain interactions with virtual objects, similar to mouse clicks.…”

Section: Related Workmentioning

confidence: 99%

“…Because such simulation can be very complex, most proposed interaction approaches are simplified, constrained, or artificial. For example, some methods recognize gestures that trigger some predefined interactions [7,25,45]. Other methods require some prior training phase [34,37].…”

Section: Introductionmentioning

confidence: 99%

See 3 more Smart Citations

Efficient Physics-Based Implementation for Realistic Hand-Object Interaction in Virtual Reality

Holl

Oberweger

Arth

et al. 2018

2018 IEEE Conference on Virtual Reality and 3D User Interfaces (VR)

View full text Add to dashboard Cite

Figure 1: Demonstration of our physics-based hand interaction method for VR environments. Our approach allows countless complex interactions such as handling a box in one hand and opening it with the other (top-left), or smashing a wall with an axe held in one hand (top-right). We can even spin an object between two fingers from two different hands (bottom-left) or from the same hand (bottom-right) in a very realistic manner. The red arrows indicate the forces calculated with our method and applied to the objects. Yellow arrows depict the global hand motion depicted for demonstration purposes only.

show abstract

Section: Related Workmentioning

confidence: 99%

Section: Related Workmentioning

confidence: 99%

Section: Related Workmentioning

confidence: 99%

Section: Introductionmentioning

confidence: 99%

See 2 more Smart Citations

Efficient Physics-Based Implementation for Realistic Hand-Object Interaction in Virtual Reality

Holl

Oberweger

Arth

et al. 2018

2018 IEEE Conference on Virtual Reality and 3D User Interfaces (VR)

View full text Add to dashboard Cite

show abstract

“…Going beyond single user interfaces, Billinghurst and Kato describe their vision of how MR could support computer supported collaborative work environments [17]. A number of studies explored hand gestures as a direct mean of interaction with holograms: HoloMuse [18] with applications in artefact manipulations in museum galleries; Yim et al investigating interactions with geographical datasets using Microsoft HoloLens [19]; Grossman et al exploring interactions with geometrical shapes using a spherical volumetric display [20]. Haptic holograms initially relied on force-feedback devices such as the Phantom stylus [21], vibrotactile gloves [22] or other wearables [8].…”

Section: Introductionmentioning

confidence: 99%

Mid-Air Haptic Bio-Holograms in Mixed Reality

Romanus¹,

Frish²,

Maksymenko³

et al. 2019

2019 IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct)

View full text Add to dashboard Cite

We present a prototype demonstrator that integrates three technologies: mixed reality head mounted displays, wearable biosensors, and mid-air haptic projectors to deliver an interactive tactile experience with a bio-hologram. Users of this prototype are able to see, touch and feel a hologram of a heart that is beating at the same rhythm as their own. The demo uses an Ultrahaptics device, a Magic Leap One Mixed Reality headset, and an Apple Watch that measures the wearer's heart rate, all synchronized and networked together such that updates from the wristband dynamically change the haptic feedback and the animation speed of the beating heart thus creating a more personalised experience.

show abstract