[POSTER] Holographic iRay: Exploring Augmentation for Medical Applications

Xie, Tian; Islam, Mohammad Mainul; Lumsden, Alan B.; Kakadiaris, Ioannis A.

doi:10.1109/ismar-adjunct.2017.73

Cited by 9 publications

(5 citation statements)

References 3 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Registration and tracking using HoloLens' contrived spatial mesh and SLAM system, without access to exact sensor information by Xie et al [14] indicated that the low‐vertex density and surface bias of the mesh, as well as the uncertainty of the SLAM, make this approach unsuitable. Garon et al [15] went as far as to attach an external depth camera to a HoloLens, thereby bypassing the data limitation.…”

Section: Introductionmentioning

confidence: 99%

Augmenting Microsoft's HoloLens with vuforia tracking for neuronavigation

Frantz

Jansen

Duerinck

et al. 2018

Healthcare Technology Letters

108

View full text Add to dashboard Cite

Major hurdles for Microsoft's HoloLens as a tool in medicine have been accessing tracking data, as well as a relatively high-localisation error of the displayed information; cumulatively resulting in its limited use and minimal quantification. The following work investigates the augmentation of HoloLens with the proprietary image processing SDK Vuforia, allowing integration of data from its front-facing RGB camera to provide more spatially stable holograms for neuronavigational use. Continuous camera tracking was able to maintain hologram registration with a mean perceived drift of 1.41 mm, as well as a mean sub 2-mm surface point localisation accuracy of 53%, all while allowing the researcher to walk about a test area. This represents a 68% improvement for the later and a 34% improvement for the former compared with a typical HoloLens deployment used as a control. Both represent a significant improvement on hologram stability given the current state-of-the-art, and to the best of the authors knowledge are the first example of quantified measurements when augmenting hologram stability using data from the RGB sensor.

show abstract

Section: Introductionmentioning

confidence: 99%

Augmenting Microsoft's HoloLens with vuforia tracking for neuronavigation

Frantz

Jansen

Duerinck

et al. 2018

Healthcare Technology Letters

108

View full text Add to dashboard Cite

show abstract

“…Microsoft has developed several Hololens applications for medical treatment [ 11 , 12 ], but most of them have not been applied to the alignment of the virtual images with the human body; instead, the virtual objects are placed in an empty space environment for educational guidance purposes. However, if it is possible to display the virtual data derived from medical images at the same time as the patient [ 13 ], then this technology is bound to be the trend of the future. This goal requires accurate alignment of the positions of the virtual data with the patients.…”

Section: Introductionmentioning

confidence: 99%

An Augmented Reality System Using Improved-Iterative Closest Point Algorithm for On-Patient Medical Image Visualization

Chien

et al. 2018

Sensors

View full text Add to dashboard Cite

In many surgery assistance systems, cumbersome equipment or complicated algorithms are often introduced to build the whole system. To build a system without cumbersome equipment or complicated algorithms, and to provide physicians the ability to observe the location of the lesion in the course of surgery, an augmented reality approach using an improved alignment method to image-guided surgery (IGS) is proposed. The system uses RGB-Depth sensor in conjunction with the Point Cloud Library (PCL) to build and establish the patient’s head surface information, and, through the use of the improved alignment algorithm proposed in this study, the preoperative medical imaging information obtained can be placed in the same world-coordinates system as the patient’s head surface information. The traditional alignment method, Iterative Closest Point (ICP), has the disadvantage that an ill-chosen starting position will result only in a locally optimal solution. The proposed improved para-alignment algorithm, named improved-ICP (I-ICP), uses a stochastic perturbation technique to escape from locally optimal solutions and reach the globally optimal solution. After the alignment, the results will be merged and displayed using Microsoft’s HoloLens Head-Mounted Display (HMD), and allows the surgeon to view the patient’s head at the same time as the patient’s medical images. In this study, experiments were performed using spatial reference points with known positions. The experimental results show that the proposed improved alignment algorithm has errors bounded within 3 mm, which is highly accurate.

show abstract

“…In the traditional CT-guided liver puncture procedure, doctors need to image the target tumor movement during the puncture procedure. Even nowadays several researchers apply the AR-guided surgical application in different types of operations [Xie et al, 2017, Qian et al, 2018, Novarad Healthcare Imaging, 2019, Scopis Inc., 2017, however, they do not take the dynamic information into account.…”

Section: Dynamic Liver Tumor Puncturementioning

confidence: 99%

“…Scopis also developed an augmented reality guided operation navigation system for spine and dental operations [Scopis Inc., 2017]. Nowadays, a lot of researchers have developed augmented reality navigation systems for different medical applications [Xie et al, 2017, Qian et al, 2018], but their guidance information is in static mode, which is not suitable for applications in dynamic conditions, like free breathing.…”

Section: Related Workmentioning

confidence: 99%

“…Optical see-through head-mounted display (OST-HMD) can well tackle this issue, it can provide the onpatient see-through guidance modality and enhance the surgeon's perception of the depth and spatial relationships of surrounding structures through the augmented reality-based fusion of 3D virtual objects with real objects [Bernhardt et al, 2017b, Guha et al, 2017a. Nowadays a lot of researchers have developed augmented reality navigation system for different medical application [Xie et al, 2017, Qian et al, 2018], but their guidance information is in static mode, which is not suitable for applications in dynamic conditions, especially for the free breathing.…”

Section: Introductionmentioning

confidence: 99%

See 1 more Smart Citation