Augmented reality for breast tumors visualization

Ghaderi, Mohammad Ali; Heydarzadeh, Mehrdad; Nourani, Mehrdad; Gupta, Gopal; Tamil, Lakshman S.

doi:10.1109/embc.2016.7591700

Cited by 8 publications

(6 citation statements)

References 20 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…[30][31][32] Some studies have also combined preoperative 3D photographs with magnetic resonance imaging data for intraoperative use. 33,34 However, only one other study acquired 3D photographs during surgery (reduction mammoplasty). 35 We demonstrated that 3D photographs can be acquired during reconstruction surgeries within acceptable time limits.…”

Section: Discussionmentioning

confidence: 99%

Potential of Intraoperative 3D Photography and 3D Visualization in Breast Reconstruction

Nicklaus

Wang

Bordes

et al. 2021

Plastic and Reconstructive Surgery - Global Open

View full text Add to dashboard Cite

Background: Although pre- and postoperative three-dimensional (3D) photography are well-established in breast reconstruction, intraoperative 3D photography is not. We demonstrate the process of intraoperative acquisition and visualization of 3D photographs for breast reconstruction and present clinicians’ opinions about intraoperative visualization tools. Methods: Mastectomy specimens were scanned with a handheld 3D scanner during breast surgery. The 3D photographs were processed to compute morphological measurements of the specimen. Three visualization modalities (screen-based viewing, augmented reality viewing, and 3D printed models) were created to show different representations of the 3D photographs to plastic surgeons. We interviewed seven surgeons about the usefulness of the visualization methods. Results: The average time for intraoperative acquisition of 3D photographs of the mastectomy specimen was 4 minutes, 8 seconds ± 44 seconds. The average time for image processing to compute morphological measurements of the specimen was 54.26 ± 40.39 seconds. All of the interviewed surgeons would be more inclined to use intraoperative visualization if it displayed information that they are currently missing (eg, the target shape of the reconstructed breast mound). Additionally, the surgeons preferred high-fidelity visualization tools (such as 3D printing) that are easy-to-use and have minimal disruption to their current workflow. Conclusions: This study demonstrates that 3D photographs can be collected intraoperatively within acceptable time limits, and quantitative measurements can be computed timely to be utilized within the same procedure. We also report surgeons’ comments on usability of visualization methods and of measurements of the mastectomy specimen, which can be used to guide future surgical practice.

show abstract

Section: Discussionmentioning

confidence: 99%

Potential of Intraoperative 3D Photography and 3D Visualization in Breast Reconstruction

Nicklaus

Wang

Bordes

et al. 2021

Plastic and Reconstructive Surgery - Global Open

View full text Add to dashboard Cite

show abstract

“…Breast cancer in transplantation patients has a similar occurrence to that of the general population but the results of treatment are much inferior [ 44 ]. Quality of Life Technology Labs designed an AR application that uses 3D mammography, breast tumor visualization, which renders its model on the patient’s body, using a head-mounted device and Android smartphone to facilitate screening and planning for breast surgery [ 45 ].…”

Section: Ar In the Assessment Of Anatomical And Pathological Structurmentioning

confidence: 99%

Applicability of Augmented Reality in an Organ Transplantation

et al. 2020

View full text Add to dashboard Cite

Augmented reality (AR) delivers virtual information or some of its elements to the real world. This technology, which has been used primarily for entertainment and military applications, has vigorously entered medicine, especially in radiology and surgery, yet has never been used in organ transplantation. AR could be useful in training transplant surgeons, promoting organ donations, graft retrieval and allocation, and microscopic diagnosis of rejection, treatment of complications, and post-transplantation neoplasms. The availability of AR display tools such as Smartphone screens and head-mounted goggles, accessibility of software for automated image segmentation and 3-dimensional reconstruction, and algorithms allowing registration, make augmented reality an attractive tool for surgery including transplantation. The shortage of hospital IT specialists and insufficient investments from medical equipment manufacturers into the development of AR technology remain the most significant obstacles in its broader application.

show abstract

“…Biomechanical modeling of the breast is integral to predicting tumor location across multimodal diagnostic imaging, [1][2][3] surgical planning, 4,5 and surgery. 6,7 Advances in model accuracy have the potential to substantially improve women's health and quality of life. Despite the growing use of breast biomechanical models for different applications, persistent knowledge gaps in both the anatomical and biomechanical literature prevent an accurate model from being developed and deployed for patient-specific applications.…”

Section: Introductionmentioning

confidence: 99%

“…Biomechanical modeling of the breast is integral to predicting tumor location across multimodal diagnostic imaging, 1–3 surgical planning, 4,5 and surgery 6,7 . Advances in model accuracy have the potential to substantially improve women's health and quality of life.…”

Section: Introductionmentioning

confidence: 99%

Technical Note: Histological validation of anatomical imaging for breast modeling using a novel cryo‐microtome

et al. 2021

View full text Add to dashboard Cite

Purpose Precise correlation between three‐dimensional (3D) imaging and histology can aid biomechanical modeling of the breast. We develop a framework to register ex vivo images to histology using a novel cryo‐fluorescence tomography (CFT) device. Methods A formalin‐fixed cadaveric breast specimen, including chest wall, was subjected to high‐resolution magnetic resonance (MR) imaging. The specimen was then frozen and embedded in an optimal cutting temperature (OCT) compound. The OCT block was placed in a CFT device with an overhead camera and 50 μm thick slices were successively shaved off the block. After each shaving, the block‐face was photographed. At select locations including connective/adipose tissue, muscle, skin, and fibroglandular tissue, 20 μm sections were transferred onto cryogenic tape for manual hematoxylin and eosin staining, histological assessment, and image capture. A 3D white‐light image was automatically reconstructed from the photographs by aligning fiducial markers embedded in the OCT block. The 3D MR image, 3D white‐light image, and photomicrographs were rigidly registered. Target registration errors (TREs) were computed based on 10 pairs of points marked at fibroglandular intersections. The overall MR‐histology registration was used to compare the MR intensities at tissue extraction sites with a one‐way analysis of variance. Results The MR image to CFT‐captured white‐light image registration achieved a mean TRE of 0.73 ± 0.25 mm (less than the 1 mm MR slice resolution). The block‐face white‐light image and block‐face photomicrograph registration showed visually indistinguishable alignment of anatomical structures and tissue boundaries. The MR intensities at the four tissue sites identified from histology differed significantly (p < 0.01). Each tissue pair, except the skin‐connective/adipose tissue pair, also had significantly different MR intensities (p < 0.01). Conclusions Fine sectioning in a highly controlled imaging/sectioning environment enables accurate registration between the MR image and histology. Statistically significant differences in MR signal intensities between histological tissues are indicators for the specificity of correlation between MRI and histology.

show abstract

Augmented reality for breast tumors visualization

Cited by 8 publications

References 20 publications

Potential of Intraoperative 3D Photography and 3D Visualization in Breast Reconstruction

Potential of Intraoperative 3D Photography and 3D Visualization in Breast Reconstruction

Applicability of Augmented Reality in an Organ Transplantation

Technical Note: Histological validation of anatomical imaging for breast modeling using a novel cryo‐microtome

Contact Info

Product

Resources

About