If citing, it is advised that you check and use the publisher's definitive version for pagination, volume/issue, and date of publication details. And where the final published version is provided on the Research Portal, if citing you are again advised to check the publisher's website for any subsequent corrections.

Due to copyright restrictions, the access to the full text of this article is only available via subscription.In this paper, real-time needle tip tracking method using 2D ultrasound (US) images for robotic biopsies is presented. In this method, the needle tip is estimated with the Gabor filter based image processing algorithm, and the estimation noise is reduced with the Kalman filter. This paper also presents the needle tip tracking simulation to test accuracy of the Kalman filter under position misalignments and tissue deformations. In order to execute proposed method in real-time, the bin packing method is used and the processing time is reduced by 56%, without a GPU. The proposed method was tested in four different phantoms and water medium. The accuracy of the needle tip estimation was measured with optical tracking system, and root mean square error (RMS) of the tip position is found to be 1.17 mm. The experiments showed that the algorithm could track the needle tip in real-time.TÜBİTA

Purpose Twin-to-twin transfusion syndrome (TTTS) is a placental defect occurring in monochorionic twin pregnancies. It is associated with high risks of fetal loss and perinatal death. Fetoscopic elective laser ablation (ELA) of placental anastomoses has been established as the most effective therapy for TTTS. Current tools and techniques face limitations in case of more complex ELA cases. Visualization of the entire placental surface and vascular equator; maintaining an adequate distance and a close to perpendicular angle between laser fiber and placental surface are central for the effectiveness of laser ablation and procedural success. Robot-assisted technology could address these challenges, offer enhanced dexterity and ultimately improve the safety and effectiveness of the therapeutic procedures. Methods This work proposes a 'minimal' robotic TTTS approach whereby rather than deploying a massive and expensive robotic system, a compact instrument is 'robotised' and endowed with 'robotic' skills so that operators can quickly and efficiently use it. The work reports on automatic placental pose estimation in fetoscopic images. This estimator forms a key building block of a proposed shared-control approach for semi-autonomous fetoscopy. A convolutional neural network (CNN) is trained to predict the relative orientation of the placental surface from a single monocular fetoscope camera image. To overcome the absence of real-life ground-truth placenta pose data, similar to other works in literature (Handa et al. in: Proceedings of the IEEE conference on computer vision and pattern recognition, 2016; Gaidon et al. in: Proceedings of the IEEE conference on computer vision and pattern recognition, 2016; Vercauteren et al. in: Proceedings of the IEEE, 2019) the network is trained with data generated in a simulated environment and an in-silico phantom model. A limited set of coarsely manually labeled samples from real interventions are added to the training dataset to improve domain adaptation. Results The trained network shows promising results on unseen samples from synthetic, phantom and in vivo patient data. The performance of the network for collaborative control purposes was evaluated in a virtual reality simulator in which the virtual flexible distal tip was autonomously controlled by the neural network. Conclusion Improved alignment was established compared to manual operation for this setting, demonstrating the feasibility to incorporate a CNN-based estimator in a real-time shared control scheme for fetoscopic applications.

Due to copyright restrictions, the access to the full text of this article is only available via subscription.Ultrasound (US) is one the most commonly used medical imaging techniques in percutaneous needle procedures. However, US images are inherently noisy and contain excessive number of artifacts. Hence, it is not easy to track the needle tip in the US images during the needle insertions. At this point, image based visual tracking techniques can be used for needle tip tracking. This paper presents a method for visual tracking of biopsy needles in 2D US images using sum of squared differences and sum of conditional variances. Second order Gauss-Newton optimization is used to decrease processing time and make the tracking more robust. The needle template images used in the method are updated with a strategy to prevent needle loss and detection failures during tracking. The paper also explains how to identify needle losses during tracking and how to recover the needle position without using a needle localization algorithm. We demonstrate the precision of the visual needle tip tracking method with experiments under challenging tracking conditions.TÜBİTA

Due to copyright restrictions, the access to the full text of this article is only available via subscription.Percutaneous needle procedures are mostly carried out with the guidance of 2D ultrasound (US) imaging. US images are inherently noisy and their resolutions are low. Hence, target tracking can be challenging. Image based tracking methods can be used to track the needle and the target. This paper proposes visual tracking of multiple moving points, such as biopsy needles and targets, in 2D US images using normalized cross correlation and mutual information similarity functions. Both moving and deformable targets can be tracked. An affine motion model is used for small and moving target tracking and a thin plate spline motion model is used for deformable target tracking. During the tracking, needle and target template images are updated with a template update strategy. Also, tracking outputs of normalized cross correlation and mutual information are fused using the Kalman filter to reduce the tracking error. During the experiments, needle is inserted using a needle insertion robot. 2D US probe is attached to a robotic arm's end effector to servo the probe along the needle insertion path. Proposed needle and target tracking methods were tested with phantoms. Accuracies of the needle tip and moving target tracking methods were measured using an optical tracking system. Experimental results showed that the proposed tracking method could be used to simultaneously track the needle tip and the targets in real-time in 2D US guided percutaneous needle procedures.TÜBİTA