Distributed biologically based real time tracking in the absence of prior target information

Abstract

We are developing a distributed system for the tracking of people and objects in complex scenes and environments using biologically based algorithms. An important component of such a system is its ability to track targets from multiple cameras at multiple viewpoints. As such, our system must be able to extract and analyze the features of targets in a manner that is sufficiently invariant of viewpoints, so that they can share information about targets, for purposes such as tracking. Since biological organisms are able to describe targets to one another from very different visual perspectives, by discovering the mechanisms by which they understand objects, it is hoped such abilities can be imparted on a system of distributed agents with many camera viewpoints. Our current methodology draws from work on saliency and center surround competition among visual components that allows for real time location of targets without the need for prior information about the targets visual features. For instance, gestalt principles of color opponencies, continuity and motion form a basis to locate targets in a logical manner. From this, targets can be located and tracked relatively reliably for short periods. Features can then be extracted from salient targets allowing for a signature to be stored which describes the basic visual features of a target. This signature can then be used to share target information with other cameras, at other viewpoints, or may be used to create the prior information needed for other types of trackers. Here we discuss such a system, which, without the need for prior target feature information, extracts salient features from a scene, binds them and uses the bound features as a set for understanding trackable objects.

Building Survivable Software Systems by Automatically Adapting to Sensor Changes

“…The goal is to improve the reliability and correctness of a software system in environments with high complexity. Recent work has studied self-aware software in Internet of Things [36,37], robotic and space applications [38,39], surveillance and security [40,41], and cloud and data centers [42,43]. Our work can be viewed as a building block for self-aware systems as these systems are often built upon sensor data.…”

An Architecture for Self -Aware IOT Applications

“…In recent years, self-aware computing has received a lot of attention in embedded and multi-core systems [4,5,6,7] but also other application areas such as surveillance and security [8,9,10,11], IoT [12], cloud and data centres [13,14,15], automotive systems [16], as well as robotic and space applications [17,18] have been investigated. In the vast majority, SA has mainly focussed on individual nodes and their local objectives rather than the collaborating collective and their common, network-wide goals.…”

The Future of Camera Networks

“…This ensures efficiency of network-wide resources, but requires either perfect re-identification or knowledge of the environment to ensure sufficient re-identification of targets among different cameras [10,13,31,34,48].…”