Development of image error correction system for 3D optical microscope

Yoon, Jiyoung; Kim, HyunDeok; Kim, Cheol-Hwan

doi:10.1109/icctim.2015.7224601

Cited by 6 publications

(5 citation statements)

References 2 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…In the stereo image alignment correction process, the left and right images are converted by homography matrix. The matched feature point pairs extracted using by Speeded-Up Robust Features algorithm in the left and right images are used to calculate the homography matrix [ 16 , 17 ]. After correcting the stereo image alignment, the vertical error of the matched feature points was 0%, the rotational error was 1.1°, and the zoom size error was 2%.…”

Section: Methodsmentioning

confidence: 99%

See-Through Type 3D Head-Mounted Display–Based Surgical Microscope System for Microsurgery: A Feasibility Study

Kim

Ryu

Yoon

et al. 2019

JMIR Mhealth Uhealth

View full text Add to dashboard Cite

BackgroundThe surgical microscope is used primarily for microsurgeries, which are more complicated than other surgical procedures and require delicate tasks for a long time. Therefore, during these surgical procedures, surgeons experience back and neck pain. To solve this problem, new technology, such as wearable displays, is required to help surgeons maintain comfortable postures and enjoy advanced functionality during microsurgery.ObjectiveThe objective of this study was to develop a surgical microscope system that would work with wearable devices. It would include a head-mounted display (HMD) that can offer 3D surgical images and allow a flexible and comfortable posture instead of fixed eyepieces of surgical microscope and can also provide peripheral visual field with its optical see-through function.MethodsWe designed and fabricated a surgical microscope system that incorporates a see-through type 3D HMD, and we developed an image processing software to provide better image quality. The usability of the proposed system was confirmed with preclinical examination. Seven ENT (ear, nose, and throat) surgical specialists and 8 residents performed a mock surgery—axillary lymph node dissection on a rat. They alternated between looking through the eyepieces of the surgical microscope and viewing a 3D HMD screen connected to the surgical microscope. We examined the success of the surgery and asked the specialists and residents to grade eye fatigue on a scale of 0 (none) to 6 (severe) and posture discomfort on a scale of 1 (none) to 5 (severe). Furthermore, a statistical comparison was performed using 2-tailed paired t test, and P=.00083 was considered significant.ResultsAlthough 3D HMD case showed a slightly better result regarding visual discomfort (P=.097), the average eye fatigue was not significantly different between eyepiece and 3D HMD cases (P=.79). However, the average posture discomfort, especially in neck and shoulder, was lower with 3D HMD display use than with eyepiece use (P=.00083).ConclusionsWe developed a see-through type 3D HMD–based surgical microscope system and showed through preclinical testing that the system could help reduce posture discomfort. The proposed system, with its advanced functions, could be a promising new technique for microsurgery.

show abstract

Section: Methodsmentioning

confidence: 99%

See-Through Type 3D Head-Mounted Display–Based Surgical Microscope System for Microsurgery: A Feasibility Study

Kim

Ryu

Yoon

et al. 2019

JMIR Mhealth Uhealth

View full text Add to dashboard Cite

show abstract

“…A polarizing film was attached on the prism surface and a 1/4 λ wave plate was placed between the prism and the curved mirror to minimize optical power loss. To reduce the weight of optical module, poly methyl methacrylate (PMMA) was used in the fabrication of the optical prisms and curved mirror, and the outside of the effective optical path was cut as shown in [16][17]. After correcting the stereo image alignment, the vertical error of the matched feature points was 0%, the rotational error was 1.1°, and the zoom size error was 2%.…”

Section: Stereoscopic Microscopementioning

confidence: 99%

See-Through Type 3D Head-Mounted Display–Based Surgical Microscope System for Microsurgery: A Feasibility Study (Preprint)

Kim¹,

Ryu²,

Yoon³

et al. 2018

Preprint

View full text Add to dashboard Cite

show abstract

“…However, it had the image output error. The image output error of our optical microscope occurred in the cause of the refractive image on the mirrors [6]. The error was generated the image is not projected on the centre point of the camera's sensor because of refraction error of mirrors.…”

Section: Image Output Error Of the Optical Microscopementioning

confidence: 99%

“…Figure 5 shows to correct stereo images using checker. If there is not the checker image, then it should be used other method [6]. We changed Third step in the method described above.…”

Section: Stereo Image Correction For 3d Optical Microscopementioning

confidence: 99%

See 1 more Smart Citation

Implementing a Stereo Image Correction Method for 3D Surgery Microscopes

Yoon

Baek

Kim

et al. 2016

JSN

Self Cite

View full text Add to dashboard Cite

Recently 3D scenes are used in various industrial fields such as medical applications, computer games, surface examinations, biology and others. 3D optical microscopes can show extremely precise details in 3D. To reconstruct the 3D images of an optical microscope, two cameras are mounted on the optical microscope. Incoming images through an object lens of an optical microscope are projected on sensors of mounted cameras by using refraction mirrors. Two cameras capture the left and right images to reconstruct the final 3D images. In this paper, we correct the 3D reconstruction errors with the SURF algorithm. We also design a hardware system to correct wrong mirror positions using servo motors. In addition, we propose the surgical system with HMD and wireless communications. This system would be helpful for doctors due to make doctors comfortable and it can be used to educate surgery procedures.

show abstract

Development of image error correction system for 3D optical microscope

Cited by 6 publications

References 2 publications

See-Through Type 3D Head-Mounted Display–Based Surgical Microscope System for Microsurgery: A Feasibility Study

See-Through Type 3D Head-Mounted Display–Based Surgical Microscope System for Microsurgery: A Feasibility Study

See-Through Type 3D Head-Mounted Display–Based Surgical Microscope System for Microsurgery: A Feasibility Study (Preprint)

Implementing a Stereo Image Correction Method for 3D Surgery Microscopes

Contact Info

Product

Resources

About