Modern techniques for medical diagnostics and therapy in keyhole surgery scenarios as well as technical inspection make use of flexible endoscopes. Their characteristic bendable image conductor consists of a very limited number of coated fibers, which leads to so-called comb structure. This effect has a negative impact on further image processing steps such as feature tracking because these overlaid image structures are wrongly detected as image features. With respect to these tasks, we propose an automatic approach to generate optimal spectral filter masks for enhancement of fiberscopic images. We apply the Nyquist-Shannon sampling theorem to the spectrum of fiberscopically acquired images to obtain parameters for optimal filter mask calculation. This can be done automatically and independently of scale and resolution of the image conductor as well as type and resolution of the image sensor. We designed and verified simple rotation invariant masks as well as star-shaped rotation variant masks that contain information about orientation between the fiberscope and sensor. A subjective survey among experts between different modes of filtering certified the best results to the adapted star-shaped mask for high-quality glass fiberscopes. We furthermore define an objective metric to evaluate the results of different filter approaches, which verifies the results of the subjective survey. The proposed approach enables the automated reduction of fiberscopic comb structure. It is adaptive to arbitrary endoscope and sensor combinations. The results give the prospect of a large field of possible applications to reduce fiberscopic structure both for visual optimization in clinical environments and for further digital imaging tasks.

No abstract

Many applications in the domain of medical as well as industrial image processing make considerable use of flexible endoscopes - so called fiberscopes - to gain visual access to holes, hollows, antrums and cavities that are difficult to enter and examine. For a complete exploration and understanding of an antrum, 3d depth information might be desirable or yet necessary. This often requires the mapping of 3d world coordinates to 2d image coordinates which is estimated by camera calibration. In order to retrieve useful results, the precise extraction of the imaged calibration pattern's markers plays a decisive role in the camera calibration process. Unfortunately, when utilizing fiberscopes, the image conductor introduces a disturbing comb structure to the images that anticipates a (precise) marker extraction. Since the calibration quality crucially depends on subpixel-precise calibration marker positions, we apply static comb structure removal algorithms along with a dynamic spatial resolution enhancement method in order to improve the feature extraction accuracy. In our experiments, we demonstrate that our approach results in a more accurate calibration of flexible endoscopes and thus allows for a more precise reconstruction of 3d information from fiberoptic images.

Modern techniques for medical diagnosis and therapy in minimal invasive surgery scenarios as well as industrial inspection make considerable use of flexible, fiberoptic endoscopes in order to gain visual access to holes, hollows, antrums and cavities that are difficult to enter and examine. Unfortunately, fiber-optic endoscopes exhibit artifacts in the images that hinder or at worst prevent fundamental image analysis techniques. The dark comb-like artifacts originate from the opaque cladding layer surrounding each single fiber in the image conductor. Although the removal of comb structure is crucial for fiber-optic image analysis, literature covers only a few approaches. Those are based on Fourier analysis and make use of spectral masking or they operate in the spatial domain and rely on interpolation. In this paper, we concentrate on the latter type and introduce interpolation concepts known from related disciplines to the task of comb structure removal. For a quantitative evaluation, we perform experiments with real images as well as with bivariate test functions and rate an algorithm's performance in terms of the normalized root mean square error - a quality metric that it is most commonly used in signal processing for this purpose. Hence, this paper counters the fact that literature lacks an objective performance comparison of the state-of-the-art interpolation based approaches for this type of application.

Fiber optics are widely used in flexible endoscopes which are indispensable for many applications in diagnosis and therapy. Computeraided use of fiberscopes requires a digital sensor mounted at the proximal end. Most commercially available cameras for endoscopy provide the images by means of a regular grid of color filters what is known as the Bayer Pattern. Hence, the images suffer from false colored spatial moiré, which is further stressed by the downgrading fiber optic transmission yielding a honey comb pattern. To solve this problem we propose a new approach that extends the interpolation between known intensities of registered fibers to multi channel color applications. The inventive idea takes into account both the Gaussian intensity distribution of each fiber and the physical color distribution of the Bayer pattern. Individual color factors for interpolation of each fiber area make it possible to simultaneously remove both the comb structure from the fiber bundle as well as the Bayer pattern mosaicking from the sensor while preserving depicted structures and textures in the scene.