Remote Sensing Image Interpretation With Semantic Graph-Based Methods: A Survey

Abstract

With the significant improvements in Earth observation (EO) technologies, remote sensing (RS) data exhibit the typical characteristics of Big Data. Propelled by the powerful feature extraction capabilities of intelligent algorithms, remote sensing image interpretation has drawn remarkable attention and achieved progress. However, the semantic relationship and domain knowledge hidden in massive RS images have not been fully exploited. To the best of our knowledge, a comprehensive review of recent achievements regarding semantic graph-based methods for comprehension and interpretation of remote sensing images is still lacking. Specifically, this article discusses the main challenges of remote sensing image interpretation and presents a systematic survey of typical semantic graph-based methodologies for RS knowledge representation and understanding, including the Ontology Model, Geo-Information Tupu, and Semantic Knowledge Graph. Furthermore, we categorize and summarize how the existing technologies address different challenges in RS image interpretation based on semantic graph-based methods, which indicates that the semantic information about potential relationships and prior knowledge of variant RS targets are central to the solution. In addition, a case study of RS geological interpretation based on the semantic knowledge graph is demonstrated to show the promising capability of intelligent RS image interpretation. Finally, the future directions are discussed for further research.

Deblurring method for remote sensing image via dual scale parallel spatial fusion network

“…This necessitates the deblurring method to possess the capability to handle images with different scales. Finally, compared to natural images, remote sensing images usually contain similar regions within a scene with high correlation between pixels, 32 e.g., continuous trees in the forest and neatly arranged aircraft at the airport. Therefore, how to use the correlation between pixels to assist image restoration is important.…”

Detection of Annual Coastal Boulder Mobility From 2017–2021 Remote Sensing Imagery (Gulf of Taranto, Mediterranean Sea) and Relation With Marine Weather Conditions

“…The interpretation of remote sensing imagery is a visual problem-solving activity which explores the relationship between objects present in the image to obtain the recognition of the image content. It is first based on the knowledge and experience of the analyst [34][35][36]. In geosciences, like aerial photo-interpretation, visual analysis of satellite imagery relies on several qualitative features of Earth's surface image, that are tone, texture, pattern, shape, context, and scale [37,38].…”

Novel Knowledge Graph- and Knowledge Reasoning-Based Classification Prototype for OBIA Using High Resolution Remote Sensing Imagery

“…For example, Li et al (2021) [18] constructed a new remote sensing knowledge graph from scratch to support the inference recognition of unseen remote sensing images. In [22], the authors demonstrated the promising capability of remote sensing semantic reasoning in the intelligent remote sensing image interpretation field by constructing a semantic knowledge graph. However, as a relational database, both the data query (query matching using similarity of attributes of image objects) and knowledge inference capabilities of the knowledge graph are advantages worth investigating in remote sensing image interpretation.…”