A low-cost multi-modal medical imaging system with fringe projection profilometry and 3D freehand ultrasound

Meza, Jhacson; Simarra, Pedro; Contreras-Ojeda, S. L.; Romero, Lenny A.; Contreras-Ortiz, Sonia H.; Cosı́o, Fernando Arámbula; Marrugo, Andrés G.

doi:10.1117/12.2542712

Cited by 7 publications

(5 citation statements)

References 0 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…5,40 Alternative optical tracking methods with fiducial markers typically work well under controlled environments. In a previous version of this work, 41 we developed a target tracking method based on OpenCV using classical computer vision techniques. Although this method yields accurate tracking and pose estimation results, it often required tuning many parameters to make it work under different environments.…”

Section: Pose Estimation Proceduresmentioning

confidence: 99%

See 1 more Smart Citation

Three-dimensional multimodal medical imaging system based on freehand ultrasound and structured light

et al. 2021

Self Cite

View full text Add to dashboard Cite

We propose a three-dimensional (3D) multimodal medical imaging system that combines freehand ultrasound and structured light 3D reconstruction in a single coordinate system without requiring registration. To the best of our knowledge, these techniques have not been combined as a multimodal imaging technique. The system complements the internal 3D information acquired with ultrasound with the external surface measured with the structured light technique. Moreover, the ultrasound probe's optical tracking for pose estimation was implemented based on a convolutional neural network. Experimental results show the system's high accuracy and reproducibility, as well as its potential for preoperative and intraoperative applications. The experimental multimodal error, or the distance from two surfaces obtained with different modalities, was 0.12 mm. The code is available in a Github repository. © 2021 Society of Photo-Optical Instrumentation Engineers (SPIE)

show abstract

Section: Pose Estimation Proceduresmentioning

confidence: 99%

“…Parts of this work were presented at the 15th International Symposium on Medical Information Processing and Analysis. 41 The authors declare no conflicts of interest.…”

Section: Acknowledgmentsmentioning

confidence: 99%

Three-dimensional multimodal medical imaging system based on freehand ultrasound and structured light

et al. 2021

Self Cite

View full text Add to dashboard Cite

show abstract

“…It consists of tracking the pose of a US probe while simultaneously acquiring US images. This procedure allows for mapping the 2D US scans to a volume by using a predefined transformation obtained via calibration [14].…”

Section: Pose Estimation For a 3d Freehand Ultrasound Systemmentioning

confidence: 99%

MarkerPose: Robust Real-time Planar Target Tracking for Accurate Stereo Pose Estimation

Meza

Romero

Marrugo

2021

LatinX in AI at Computer Vision and Pattern Recognition Conference 2021

Self Cite

View full text Add to dashboard Cite

Despite the attention marker-less pose estimation has attracted in recent years, marker-based approaches still provide unbeatable accuracy under controlled environmental conditions. Thus, they are used in many fields such as robotics or biomedical applications but are primarily implemented through classical approaches, which require lots of heuristics and parameter tuning for reliable performance under different environments. In this work, we propose MarkerPose, a robust, real-time pose estimation system based on a planar target of three circles and a stereo vision system. MarkerPose is meant for high-accuracy pose estimation applications. Our method consists of two deep neural networks for marker point detection. A SuperPoint-like network for pixel-level accuracy keypoint localization and classification, and we introduce EllipSegNet, a lightweight ellipse segmentation network for sub-pixel-level accuracy keypoint detection. The marker’s pose is estimated through stereo triangulation. The target point detection is robust to low lighting and motion blur conditions. We compared MarkerPose with a detection method based on classical computer vision techniques using a robotic arm for validation. The results show our method provides better accuracy than the classical technique. Finally, we demonstrate the suitability of MarkerPose in a 3D freehand ultrasound system, which is an application where highly accurate pose estimation is required. Code is available in Python and C++ at https://github.com/jhacsonmeza/MarkerPose.

show abstract

Section: Pose Estimation Proceduresmentioning

confidence: 99%

“…Parts of this work were presented at the 15th International Symposium on Medical Information Processing and Analysis. 41…”

Section: Acknowledgmentsmentioning

confidence: 99%

Three-dimensional multimodal medical imaging system based on free-hand ultrasound and structured light

Meza,

Contreras-Ortiz,

Romero

et al. 2021

Preprint

Self Cite

View full text Add to dashboard Cite

We propose a three-dimensional (3D) multimodal medical imaging system that combines freehand ultrasound and structured light 3D reconstruction in a single coordinate system without requiring registration. To the best of our knowledge, these techniques have not been combined before as a multimodal imaging technique. The system complements the internal 3D information acquired with ultrasound, with the external surface measured with the structure light technique. Moreover, the ultrasound probe's optical tracking for pose estimation was implemented based on a convolutional neural network. Experimental results show the system's high accuracy and reproducibility, as well as its potential for preoperative and intraoperative applications. The experimental multimodal error, or the distance from two surfaces obtained with different modalities, was 0.12 mm. The code is available as a Github repository.

show abstract

A low-cost multi-modal medical imaging system with fringe projection profilometry and 3D freehand ultrasound

Cited by 7 publications

References 0 publications

Three-dimensional multimodal medical imaging system based on freehand ultrasound and structured light

Three-dimensional multimodal medical imaging system based on freehand ultrasound and structured light

MarkerPose: Robust Real-time Planar Target Tracking for Accurate Stereo Pose Estimation

Three-dimensional multimodal medical imaging system based on free-hand ultrasound and structured light

Contact Info

Product

Resources

About