A semiconductor backscattered electron (BSE) detector has become popular in scanning electron microscopy session. However, detectors of semiconductor type have a serious disadvantage on the frequency characteristics. As a result, fast scan (e.g. TV-scan) BSE image should be blurred remarkably. It is the purpose of this study to restore this degradation by using digital image processing technology. In order to improve it practically, we have to settle several problems, such as noise, undesirable processing artifacts, and ease of use. Image processing techniques in an impromptu manner like a conventional mask processing are unhelpful for this study, because a complicated degradation of output signal affects severely the phase response as well as the amplitude response of our SEM system. Hence, based on the characteristics of an SEM signal obtained from the semiconductor BSE detector, a proper inverse filter in Fourier domain is designed successfully. Finally, the inverse filter is converted to a special convolution mask, which is skillfully designed, and applied for TV-scan moving BSE images. The improved BSE image is very effective in the work for finding important objects.