Miniaturised high-resolution imaging devices are valuable for guiding minimally invasive procedures such as vascular stent placements. Here, we present all-optical rotational B-mode pulse-echo ultrasound imaging. With this device, ultrasound transmission and reception are performed with light. The all-optical transducer in the probe comprised an optical fibre that delivered pulsed excitation light to an optical head at the distal end with a multi-walled carbon nanotube and polydimethylsiloxane composite coating. This coating was photoacoustically excited to generate a highly directional ultrasound beam perpendicular to the optical fibre axis. A concave Fabry-Pérot cavity at the distal end of an optical fibre, which was interrogated with a tuneable continuous-wave laser, served as an omnidirectional ultrasound receiver. The transmitted ultrasound had a −6 dB bandwidth of 31.3 MHz and a peak-to-peak pressure of 1.87 MPa, as measured at 1.5 mm from the probe. The receiver had a noise equivalent pressure <100 Pa over a 20 MHz bandwidth. With a maximum outer probe diameter of 1.25 mm, the probe provided imaging with an axial resolution better than 50 µm, and a real-time imaging rate of 5 frames per second. To investigate the capabilities of the probe, intraluminal imaging was performed in healthy swine carotid arteries. The results demonstrate that the all-optical probe is viable for clinical rotational ultrasound imaging.

Purpose Fetoscopic laser photocoagulation is a minimally invasive surgical procedure used to treat twin-to-twin transfusion syndrome (TTTS), which involves localization and ablation of abnormal vascular connections on the placenta to regulate the blood flow in both fetuses. This procedure is particularly challenging due to the limited field of view, poor visibility, occasional bleeding, and poor image quality. Fetoscopic mosaicking can help in creating an image with the expanded field of view which could facilitate the clinicians during the TTTS procedure. Methods We propose a deep learning-based mosaicking framework for diverse fetoscopic videos captured from different settings such as simulation, phantoms, ex vivo, and in vivo environments. The proposed mosaicking framework extends an existing deep image homography model to handle video data by introducing the controlled data generation and consistent homography estimation modules. Training is performed on a small subset of fetoscopic images which are independent of the testing videos. Results We perform both quantitative and qualitative evaluations on 5 diverse fetoscopic videos (2400 frames) that captured different environments. To demonstrate the robustness of the proposed framework, a comparison is performed with the existing feature-based and deep image homography methods. Conclusion The proposed mosaicking framework outperformed existing methods and generated meaningful mosaic, while reducing the accumulated drift, even in the presence of visual challenges such as specular highlights, reflection, texture paucity, and low video resolution.

Robot-assisted laparoscopic prostatectomy (RALP) is a treatment for prostate cancer that involves complete or nerve sparing removal prostate tissue that contains cancer. After removal the bladder neck is successively sutured directly with the urethra. The procedure is called urethrovesical anastomosis and is one of the most dexterity demanding tasks during RALP. Two suturing instruments and a pair of needles are used in combination to perform a running stitch during urethrovesical anastomosis. While robotic instruments provide enhanced dexterity to perform the anastomosis, it is still highly challenging and difficult to learn. In this paper, we presents a vision-guided needle grasping method for automatically grasping the needle that has been inserted into the patient prior to anastomosis. We aim to automatically grasp the suturing needle in a position that avoids hand-offs and immediately enables the start of suturing. The full grasping process can be broken down into: a needle detection algorithm; an approach phase where the surgical tool moves closer to the needle based on visual feedback; and a grasping phase through path planning based on observed surgical practice. Our experimental results show examples of successful autonomous grasping that has the potential to simplify and decrease the operational time in RALP by assisting a small component of urethrovesical anastomosis.