Gain A New Perspective: Towards Exploring Multi-View Alignment in Mixed Reality

Martin-Gomez, Alejandro; Fotouhi, Javad; Eck, Ulrich; Navab, Nassir

doi:10.1109/ismar50242.2020.00044

Cited by 11 publications

(3 citation statements)

References 31 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…The Utah teapot is selected due to its distinct geometric features, such as spout, handle and lid. As discussed by Martin-Gomez et al [15], such distinct features provide useful cues for orientation.…”

Section: Docking Tasksmentioning

confidence: 94%

“…There are many factors that affect the efficiency and convenience of mid-air manipulation. They include degrees of freedom [20], virtual object shapes [15] and sizes [30]. With respect to the object sizes, it has been discovered that the performance of manipulation tasks decreases significantly if virtual objects are too small or too large [8,35,38].…”

Section: Introductionmentioning

confidence: 99%

See 1 more Smart Citation

Virtual object sizes for efficient and convenient mid-air manipulation

et al. 2022

View full text Add to dashboard Cite

It has been taken for granted that the sizes of virtual objects affect the efficiency and convenience of mid-air manipulation in immersive virtual environments. If a virtual object is too small or too large, for example, manipulating it becomes a difficult task. Nevertheless, the virtual object sizes that are optimal and convenient have rarely been studied. In this paper, we select a virtual object with many distinct geometric features and conduct user studies via docking tasks. Through the user studies, the optimal and convenient sizes for mid-air manipulation are estimated. In order to verify the results, a proxy-based manipulation method is designed and implemented, where the proxy is created with the estimated optimal size. The test based on the method shows that the optimal-size proxy enables users to manipulate efficiently virtual objects and the estimated range of convenient sizes is also preferred by the users.

show abstract

Section: Docking Tasksmentioning

confidence: 94%

Section: Introductionmentioning

confidence: 99%

Virtual object sizes for efficient and convenient mid-air manipulation

et al. 2022

View full text Add to dashboard Cite

show abstract

“…For this, some participants experienced "blurred images" feeling. This could mean that it might take time for some users to get familiar with the OST HMD even to perceive depth in details: some user suggested the use of another perspective to be certain of a good alignment which can be solved for example by the use of augmented mirrors [45,46].…”

Section: Participants' Feedbackmentioning

confidence: 99%

Evaluation of AR visualization approaches for catheter insertion into the ventricle cavity

Benmahdjoub

Thabit

Veelen

et al. 2023

IEEE Trans. Visual. Comput. Graphics

View full text Add to dashboard Cite

Augmented reality (AR) has shown potential in computer-aided surgery. It allows for the visualization of hidden anatomical structures as well as assists in navigating and locating surgical instruments at the surgical site. Various modalities (devices and/or visualizations) have been used in the literature, but few studies investigated the adequacy/superiority of one modality over the other. For instance, the use of optical see-through (OST) HMDs has not always been scientifically justified. Our goal is to compare various visualization modalities for catheter insertion in external ventricular drain and ventricular shunt procedures. We investigate two AR approaches: (1) 2D approaches consisting of a smartphone and a 2D window visualized through an OST (Microsoft HoloLens 2), and (2) 3D approaches consisting of a fully aligned patient model and a model that is adjacent to the patient and is rotationally aligned using an OST. 32 participants joined this study. For each visualization approach, participants were asked to perform five insertions after which they filled NASA-TLX and SUS forms. Moreover, the position and orientation of the needle with respect to the planning during the insertion task were collected. The results show that participants achieved a better insertion performance significantly under 3D visualizations, and the NASA-TLX and SUS forms reflected the preference of participants for these approaches compared to 2D approaches.

show abstract

Multimodal markers for technology-independent integration of augmented reality devices and surgical navigation systems

et al. 2022

View full text Add to dashboard Cite

Augmented reality (AR) permits the visualization of pre-operative data in the surgical field of view of the surgeon. This requires the alignment of the AR device’s coordinate system with the used navigation/tracking system. We propose a multimodal marker approach to align an AR device with a tracking system: in our implementation, an electromagnetic tracking system (EMTS). The solution makes use of a calibration method which determines the relationship between a 2D pattern detected by an RGB camera and an electromagnetic sensor of the EMTS. This allowed the projection of a 3D skull model on its physical counterpart. This projection was evaluated using a monocular camera and an optical see-through device (HoloLens 2) (https://www.microsoft.com/en-us/hololens/) achieving an accuracy of less than 2.5 mm in the image plane of the HoloLens 2 (HL2). Additionally, 10 volunteers participated in a user study consisting of an alignment task of a pointer with 25 projections viewed through the HL2. The participants achieved a mean error of 2.7 1.3 mm and 2.9 2.9$$^\circ $$ ∘ in positional and orientation error. This study showcases the feasibility of the approach, provides an evaluation of the alignment, and finally, discusses its advantages and limitations.

show abstract

Gain A New Perspective: Towards Exploring Multi-View Alignment in Mixed Reality

Cited by 11 publications

References 31 publications

Virtual object sizes for efficient and convenient mid-air manipulation

Virtual object sizes for efficient and convenient mid-air manipulation

Evaluation of AR visualization approaches for catheter insertion into the ventricle cavity

Multimodal markers for technology-independent integration of augmented reality devices and surgical navigation systems

Contact Info

Product

Resources

About