Formation of Fused Images of the Land Surface from Radar and Optical Images in Spatially Distributed On-Board Operational Monitoring Systems

Abstract

This paper considers the issues of image fusion in a spatially distributed small-size on-board location system for operational monitoring. The purpose of this research is to develop a new method for the formation of fused images of the land surface based on data obtained from optical and radar devices operated from two-position spatially distributed systems of small aircraft, including unmanned aerial vehicles. The advantages of the method for integrating information from radar and optical information-measuring systems are justified. The combined approach allows removing the limitations of each separate system. The practicality of choosing the integration of information from several widely used variants of heterogeneous sources is shown. An iterative approach is used in the method for combining multi-angle location images. This approach improves the quality of synthesis and increases the accuracy of integration, as well as improves the information content and reliability of the final fused image by using the pixel clustering algorithm, which produces many partitions into clusters. The search for reference points on isolated contours is carried out on a pair of left and right images of the docked image from the selected partition. For these reference points, a functional transformation is determined. Having applied it to the original multi-angle heterogeneous images, the degree of correlation of the fused image is assessed. Both the position of the reference points of the contour and the desired functional transformation itself are refined until the quality assessment of the fusion becomes acceptable. The type of functional transformation is selected based on clustered images and then applied to the original multi-angle heterogeneous images. This process is repeated for clustered images with greater granularity in case if quality assessment of the fusion is considered to be poor. At each iteration, there is a search for pairs of points of the contour of the isolated areas. Areas are isolated with the use of two image segmentation methods. Experiments on the formation of fused images are presented. The result of the research is the proposed method for integrating information obtained from a two-position airborne small-sized radar system and an optical location system. The implemented method can improve the information content, quality, and reliability of the finally established fused image of the land surface.

A Model of Pixel and Superpixel Clustering for Object Detection

“…We are working on the implementation of a model for solving the engineering problems [ 47 , 48 ]. However, this is not the main thing, as modern image processing contains a variety of different engineering solutions.…”

Comparative Analysis of Centralized and Decentralized Algorithms for the Movement of Multicopter-Type Uavs

“…Поддержание заданного строя актуально при решении задач движения колонной [1], слежения за целью [2], ретрансляции связи [3], поиска объектов [4], проведения георазведки [5]. Перспективной задачей является создание на базе группы БЛА многопозиционных радиолокационных или оптических систем [6][7][8][9]. Такие системы, обладая преимуществами многопозиционных систем, обеспечивают быстрое развертывание в заданном направлении и перемещение в требуемую область.…”

“…Матрица инерционных параметров сбалансированного БЛА имеет вид (8) где m -масса БЛА; J x , J y , J z , J xy , J xz , J yz -моменты инерции относительно осей связанной системы координат БЛА; y T -отклонение масс БЛА относительно начала координат связанной системы по оси OY.…”

Example-Based Object Detection in the Attached Image

“…Ward's original method is undeservedly rarely used for image pixel clustering, firstly, because of the supposedly excessive computational complexity, and secondly, because of some instability of the results when varying the image, changing the number of pre-enlarged pixels, etc. In our experience, Ward's original pixel clustering is good for detecting instances of objects in the same color in one and the same image, which makes it possible to improve object detection using the image merging technique [1][2][3]. However, to make full use of Ward's pixel clustering, the method needs to be upgraded in accordance with the features of the input image data.…”

“…A pronounced improvement in object detection when images are merged into single one was noticed for stereopairs [1] and is used to recognize remote images of the same scene [2,3]. To develop an utilization of the idea, let's attach the input image to the image of object-of-interest examples and approach the joint image by a sequence of piecewise constant approximations in the color numbers from 1 to N , where N is the number of pixels in the image.…”