Augmented visual feature modeling for matching in low-visibility based on cycle-labeling of Superpixel Flow

Abstract

There are many automation systems that are required to work under poor visual conditions, such as auto-navigation in foggy or underwater environment. The low-visibility poses challenges for traditional feature modelling methods, which commonly contribute as a key component to such autonomous systems. It can thus negatively impact the performance of those computing systems. For example, the matching precision (matching quality) and the successfully identified matches (matching quantity) can both drop dramatically in low-visibility. On the other hand, human vision system can robustly identify visual features correctly despite the variations in lighting conditions. Inspired by human knowledge of perceiving visual features, this paper presents a novel feature modelling solution under poor visual conditions. Based on a color constancy enhanced illumination alignment, a new concept called Superpixel Flow (SPF) is proposed to model the visual features in images. SPF is generated considering the content motions across frame pairs, which make it easier to track across frames compared with classic Superpixels. The matching is achieved by a cycle-labelling strategy using Markov Random Field (MRF) with energy functions composed according to human knowledge of compare visual features. An outlier removal follows to further improve the matching accuracy. Competitive performance is demonstrated in the experiments compared with state-of-the-art approaches.

Design of Athlete’s Running Information Capture System in Space-Time Domain Based on Virtual Reality

“…e construction of the virtual reality environment is the basis of the software design of the running information capture system of the entire athlete's time and space domain, which mainly includes three-dimensional visual modeling and three-dimensional auditory modeling [24,25]. Among them, visual modeling mainly includes geometric modeling, motion modeling, physical modeling, object behavior modeling and model segmentation, and so on [26,27]. Auditory modeling usually just adds interactive sound responses to the activities of users and objects.…”

Application of computer vision in fish intelligent feeding system—A review

“…In the computer system, there is a specific value of the matching accuracy and the number of matches. This value will decrease as visibility decreases (Zhang et al., 2020). But in the human visual system, humans can still accurately recognize visual features despite changing light conditions.…”