SLIM (slit lamp image mosaicing): handling reflection artifacts

Prokopetc, Kristina; Bartoli, Adrien

doi:10.1007/s11548-017-1555-z

Cited by 9 publications

(7 citation statements)

References 20 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…The most standard approach for stitching images consists of the registration of overlapping pairs via the detection and matching of landmarks [6]. Such feature-based methods have been successfully applied for some medical applications, such as retinal mosaicking [16] and fibroscopic video mosaicking [2]. However, other type of clinical images may display a lack of texture, occlusions and other factors that make a landmarkbased registration of a pair of images not reliable enough.…”

Section: Introductionmentioning

confidence: 99%

Retrieval and registration of long-range overlapping frames for scalable mosaicking of in vivo fetoscopy

et al. 2018

View full text Add to dashboard Cite

PurposeThe standard clinical treatment of Twin-to-Twin transfusion syndrome consists in the photo-coagulation of undesired anastomoses located on the placenta which are responsible to a blood transfer between the two twins. While being the standard of care procedure, fetoscopy suffers from a limited field-of-view of the placenta resulting in missed anastomoses. To facilitate the task of the clinician, building a global map of the placenta providing a larger overview of the vascular network is highly desired.MethodsTo overcome the challenging visual conditions inherent to in vivo sequences (low contrast, obstructions or presence of artifacts, among others), we propose the following contributions: (1) robust pairwise registration is achieved by aligning the orientation of the image gradients, and (2) difficulties regarding long-range consistency (e.g. due to the presence of outliers) is tackled via a bag-of-word strategy, which identifies overlapping frames of the sequence to be registered regardless of their respective location in time.ResultsIn addition to visual difficulties, in vivo sequences are characterised by the intrinsic absence of gold standard. We present mosaics motivating qualitatively our methodological choices and demonstrating their promising aspect. We also demonstrate semi-quantitatively, via visual inspection of registration results, the efficacy of our registration approach in comparison with two standard baselines.ConclusionThis paper proposes the first approach for the construction of mosaics of placenta in in vivo fetoscopy sequences. Robustness to visual challenges during registration and long-range temporal consistency are proposed, offering first positive results on in vivo data for which standard mosaicking techniques are not applicable.Electronic supplementary materialThe online version of this article (10.1007/s11548-018-1728-4) contains supplementary material, which is available to authorized users.

show abstract

Section: Introductionmentioning

confidence: 99%

Retrieval and registration of long-range overlapping frames for scalable mosaicking of in vivo fetoscopy

et al. 2018

View full text Add to dashboard Cite

show abstract

“…Comprehensive research can be found in [15]. This technique is also used in medicine such as slit lamp image mosaicing [7,16,17]. For instance, Cattin et al [16] describe an approach for mosaic retina images based on Speeded-Up Robust Features (SURF) [18].…”

Section: Image Stitchingmentioning

confidence: 99%

Designing a New Endoscope for Panoramic-View with Focus-Area 3D-Vision in Minimally Invasive Surgery

et al. 2019

View full text Add to dashboard Cite

Purpose The minimally invasive surgery (MIS) has shown advantages when compared to traditional surgery. However, there are two major challenges in the MIS technique: the limited field of view (FOV) and the lack of depth perception provided by the standard monocular endoscope. Therefore, in this study, we proposed a New Endoscope for Panoramic-View with Focus-Area 3D-Vision (3DMISPE) in order to provide surgeons with a broad view field and 3D images in the surgical area for real-time display. Method The proposed system consisted of two endoscopic cameras fixed to each other. Compared to our previous study, the proposed algorithm for the stitching videos was novel. This proposed stitching algorithm was based on the stereo vision synthesis theory. Thus, this new method can support 3D reconstruction and image stitching at the same time. Moreover, our approach employed the same functions on reconstructing 3D surface images by calculating the overlap region's disparity and performing image stitching with the two-view images from both the cameras. Results The experimental results demonstrated that the proposed method can combine two endoscope's FOV into one wider FOV. In addition, the part in the overlap region could also be synthesized for a 3D display to provide more information about depth and distance, with an error of about 1 mm. In the proposed system, the performance could achieve a frame rate of up to 11.3 fps on a single Intel i5-4590 CPU computer and 17.6 fps on a computer with an additional GTX1060 Nvidia GeForce GPU. Furthermore, the proposed stitching method in this study could be made 1.4 times after when compared to that in our previous report. Besides, our method also improved stitched image quality by significantly reducing the alignment errors or "ghosting" when compared to the SURF-based stitching method employed in our previous study. Conclusion The proposed system can provide a more efficient way for the doctors with a broad area of view while still providing a 3D surface image in real-time applications. Our system give promises to improve existing limitations in laparoscopic surgery such as the limited FOV and the lack of depth perception.

show abstract

“…Accordingly, we include in this related work review the literature on flare spot detection. The methods found can be classified into two groups, depending on the provided input information: semi-automatic [30,27,42] and automatic [6,29].…”

Section: Related Researchmentioning

confidence: 99%

“…This fact entails a a high percentage of false positives and a low detection precision. The recent work [29] aims to detect and correct light reflections in retinal images. It detects the flare using the specular-free image concept [37] and a probability map.…”

Section: Related Researchmentioning

confidence: 99%

“…Although there are applications where the flare artifacts are not undesirable − e.g., some film directors use flare as an element of realism or even as an extra character in their movies −, in other contexts flare identification is a pivotal problem, for instance, in order to avoid false detections. This is the case in medical diagnosis assistance − e.g., in slit lamp retina images where flare anomalies corrupt the retinal content [29] −, in order to distinguish from aerial objects following a collision track in aerial images [27], or in the context of surveillance camera systems, to mention but a few. Moreover, there are situations where in unique shooting circumstances (e.g., studio photographs, special events, etc), the flare artifacts are unwanted or annoying and significantly degrade the quality of the image.…”

Section: Introductionmentioning

confidence: 99%

See 1 more Smart Citation

Automatic Flare Spot Artifact Detection and Removal in Photographs

Vitoria

Ballester

2018

J Math Imaging Vis

View full text Add to dashboard Cite

Flare spot is one type of flare artifact caused by a number of conditions, frequently provoked by one or more high-luminance sources within or close to the camera field of view. When light rays coming from a high-luminance source reach the front element of a camera, it can produce intra-reflections within camera elements that emerge at the film plane forming non-image information or flare on the captured image. Even though preventive mechanisms are used, artifacts can appear. In this paper, we propose a robust computational method to automatically detect and remove flare spot artifacts. Our contribution is threefold: firstly, we propose a characterization which is based on intrinsic properties that a flare spot is likely to satisfy; secondly, we define a new confidence measure able to select flare spots among the candidates; and, finally, a method to accurately determine the flare region is given. Then, the detected artifacts are removed by using exemplar-based inpainting. We show that our algorithm achieve top-tier quantitative and qualitative performance.

show abstract

SLIM (slit lamp image mosaicing): handling reflection artifacts

Abstract: The experiments demonstrated that integrating the proposed method to the mosaicing framework significantly improves the global photometric quality of the mosaics and outperforms existing works in SLIM.

Cited by 9 publications

References 20 publications

Retrieval and registration of long-range overlapping frames for scalable mosaicking of in vivo fetoscopy

Retrieval and registration of long-range overlapping frames for scalable mosaicking of in vivo fetoscopy

Designing a New Endoscope for Panoramic-View with Focus-Area 3D-Vision in Minimally Invasive Surgery

Automatic Flare Spot Artifact Detection and Removal in Photographs

Contact Info

Product

Resources

About