Challenges of intracellular visualization using virtual and augmented reality

Abstract

Microscopy image observation is commonly performed on 2D screens, which limits human capacities to grasp volumetric, complex, and discrete biological dynamics. With the massive production of multidimensional images (3D + time, multi-channels) and derived images (e.g., restored images, segmentation maps, and object tracks), scientists need appropriate visualization and navigation methods to better apprehend the amount of information in their content. New modes of visualization have emerged, including virtual reality (VR)/augmented reality (AR) approaches which should allow more accurate analysis and exploration of large time series of volumetric images, such as those produced by the latest 3D + time fluorescence microscopy. They include integrated algorithms that allow researchers to interactively explore complex spatiotemporal objects at the scale of single cells or multicellular systems, almost in a real time manner. In practice, however, immersion of the user within 3D + time microscopy data represents both a paradigm shift in human-image interaction and an acculturation challenge, for the concerned community. To promote a broader adoption of these approaches by biologists, further dialogue is needed between the bioimaging community and the VR&AR developers.

Metaverse Wearables for Immersive Digital Healthcare: A Review

“…[122][123][124] The approaches can more accurately analyze multidimensional data by selecting and annotating subregions. [125] A confocal VR system was developed to observe the image stack of cellular structures through a VR headset (Figure 8a). [126] Hand controllers can adjust visual parameters such as the brightness and contrast of a rendered 3D image and rotate and scale the image (Figure 8b).…”

“…[ 122 , 123 , 124 ] The approaches can more accurately analyze multidimensional data by selecting and annotating subregions. [ 125 ]…”