Integrated volume visualization of functional image data and anatomical surfaces using normal fusion

Abstract

A generic method, called normal fusion, for integrated three-dimensional (3D) visualization of functional data with surfaces extracted from anatomical image data is described. The first part of the normal fusion method derives quantitative values from functional input data by sampling the latter along a path determined by the (inward) normal of a surface extracted from anatomical data; the functional information is thereby projected onto the anatomical surface independently of the viewpoint. Fusion of the anatomical and functional information is then performed with a color-encoding scheme based on the HSV model. This model is preferred over the RGB model to allow easy, rapid, and intuitive retrospective manipulation of the color encoding of the functional information in the integrated display, and two possible strategies for this manipulation are explained. The results first show several clinical examples that are used to demonstrate the viability of the normal fusion method. These same examples are then used to evaluate the two HSV color manipulation strategies. Furthermore, five nuclear medicine physicians used several other clinical cases to evaluate the overall approach for manipulation of the color encoded functional contribution to an integrated 3D visualization. The integrated display using the normal fusion technique combined with the added functionality provided by the retrospective color manipulation was highly appreciated by the clinicians and can be considered an important asset in the investigation of data from multiple modalities.

Telencephalon: Neocortex

“…However, it is also conceivable that more refined analyses will lead to a further functional parcellation of the areas involved. a Attention [684] b Calculation [684] c Activation arising from a working memory task [66] d Processing of incorrect arithmetic equations [461] e Maternal love [39] f Performance of a verbal working memory task [583] g Reading aloud irregular words [289] h Meditative state [418] j Finger opposition task [713] k Visual-spatial orienting [450] l Coherence processes in language comprehension [184] m Executive function in working memory [523] n Embarrassment [724] o Perception of visual motion: V5…”

Multimodal medical image fusion in NSST domain with structural and spectral features enhancement

“…HSV method proposed in Ref. [ 12 ] fused the MRI and SPECT images by employing a color encoding mechanism. It provides better structural and metabolic features with less spectral distortion.…”

A Survey on Multimodal Medical Data Visualization

“…They combined segmented structures and vessels with functional areas from magnetoencephalography (MEG) and fMRI data in a neuro-navigation application. As one of the most notable early techniques where surfaces are used for combined information, Stokking et al presented a visualization method that combines functional input data and a surface extracted from anatomical data [SZV01]. They map fMRI values onto a brain surface using the surface normal and evaluate their technique on both registered (S)PE(C)T/MRI and fMRI/MRI.…”