Perception enhancement using importance-driven hybrid rendering for augmented reality based endoscopic surgical navigation

Abstract

Misleading depth perception may greatly affect the correct identification of complex structures in image-guided surgery. In this study, we propose a novel importancedriven hybrid rendering method to enhance perception for navigated endoscopic surgery. First, the volume structures are enhanced using gradient-based shading to reduce the color information in low-priority regions and improve the distinctions between complicated structures. Second, an importance sorting method based on the order-independent transparency rendering is introduced to intensify the perception of multiple surfaces. Third, volume data are adaptively truncated and emphasized with respect to the perspective orientation and the illustration of critical information for viewing range extension. Various experimental results prove that with the combination of volume and surface rendering, our method can effectively improve the depth distinction of multiple objects both in simulated and clinical scenes. Our importance-driven surface rendering method demonstrates improved average performance and statistical significance as rated by 15 participants (five clinicians and ten non-clinicians) on a five-point Likert scale. Further, the average frame rate of hybrid rendering with thin-layer sectioning reaches 42 fps. Given that the process of the hybrid rendering is fully automatic, it can be utilized in real-time surgical navigation to improve the rendering efficiency and information validity.

High stability in color chromaticity of warm White emitting Diode with Dual-Hue SrSi2O2N2:Eu2+,Yb2+ Oxynitridosilicate Phosphorus

“…Especially challenging is the color consistency of a distant structure at high temperatures. Researchers found that SrSi 2 O 2 N 2 , including low (5,600 K) and high (8,500 K) hue heats, may improve the WLEDs' color quality [19]- [21]. Figure 4 indicates the hue dispersion in the three mean CCTs was considerably reduced when the SrYb concentration was higher.…”

Effects of NaB₂O₄:Mn²⁺ and Ba₂Li₂Si₂O₇:Sn³⁺,Mn²⁺ phosphors and remote structure organizations on the white light-emitting diodes with quantum dots and phosphors

“…In this part, the mathematical model of the passed through blue light and transformed yellow light in the triple-layer phosphor form are demonstrated in details to discuss the improvement that can be yielded from these parts. The passed through blue light and transformed yellow light for double-layer remote package with the phosphor layer thickness of h are expressed as [25], [26]:…”

User's image perception improved strategy and application of augmented reality systems in smart medical care: A review

“…Palumbo 33 conduct a systematic review of Microsoft HoloLens2 applications in healthcare since 2019, as well as the device features available to users and the software/platform/framework used, highlighting the potential and limitations of Microsoft HoloLens2 as an innovative solution for emerging research topics such as telemedicine, remote control, and motor rehabilitation. The above study shows that AR systems are currently being used successfully in oral and maxillofacial surgery, 13–17 neurosurgery, 12 cancer surgery 18,19 and internal medicine surgery 20–23 . Furthermore, experts have shown that integrating AR into medical education improves the traditional teaching model and significantly improves the immersion and interactivity of the practical training process 34,35 …”