Region search based on hybrid convolutional neural network in optical remote sensing images

Abstract

Currently, big data is a new and hot issue. Particularly, the rapid growth of the Internet of Things causes a sharp growth of data. Enormous amounts of networking sensors are continuously collecting and transmitting data to be stored and processed in the cloud, including remote sensing data, environmental data, and geographical data. And region is regarded as the very important object in remote sensing data, which is mainly researched in this article. Region search is a crucial task in remote sensing process, especially for military area and civilian fields. It is difficult to fast search region accurately and achieve generalizability of the regions’ features due to the complex background information, as well as the smaller size. Especially, when processing region search in large-scale remote sensing image, detailed information as the feature can be extracted in inner region. To overcome the above difficulty region search task, we propose an accurate and fast region search in optical remote sensing images under cloud computing environment, which is based on hybrid convolutional neural network. The proposed region search method partitioned into four processes. First, fully convolutional network is adopted to produce all the candidate regions that contain the possible object regions. This process avoids exhaustive search for input images. Then, the features of all candidate regions are extracted by a fast region-based convolutional neural network structure. Third, we design a new difficult sample mining method for the training process. At the end, in order to improve the region search precision, we use an iterative bounding box regression algorithm to normalize the detected bounding boxes, in which the regions contain candidate objects. The proposed algorithm is evaluated on optical remote sensing images acquired from Google Earth. Finally, we conduct the experiments, and the obtained results show that the proposed region search method constantly achieves better results regardless of the type of images tested. Compared with traditional region search methods, such as region-based convolutional neural network and newest feature extraction frameworks, our proposed methods show better robustness with complex context semantic information and backgrounds.

A Novel DenseNet Generative Adversarial Network for Heterogenous Low-Light Image Enhancement

“…Figure 1 shows the structure of a Dense block. Block module is the core part of the DenseNet, the main feature is that each layer of the network is not only connected to the next layer (Shoulin et al, 2019), but also directly connected to each layer after this layer. The input of each layer comes from the output of all previous layers.…”

Multi-Scale Bushfire Detection From Multi-Modal Streams of Remote Sensing Data

“…Moreover, it takes only the first three PCA components of spectral information; and thus would neglect complex dependencies between spectral channels. New approaches such as convolutional neural networks have been designed to capture spatial patterns [20], [21], [22]. However, they consider only global dependencies by applying a biased weighted combination of all spectral channels at the same time; and thus, could miss partial dependencies betwee them.…”

Multi-scale information fusion based on convolution kernel pyramid and dilated convolution for Wushu moving object detection

“…If this scheme is also adopted in this paper, the same number of anchor frames of different proportions will be generated for each convolution kernel on the original image, and 46208 (38×38 (2×4+4×6)) anchor frames will be generated with the input of the model of 300×300 pixels. It can be seen from YOLOv2 that the average detection accuracy will decrease if the number of anchor frames is too much [32]. Therefore, this paper proposes a scheme to reduce the number of anchor frames according to the resolution of the generated predictive tensor.…”