Visual Detection and Tracking System for a Spherical Amphibious Robot

Abstract

With the goal of supporting close-range observation tasks of a spherical amphibious robot, such as ecological observations and intelligent surveillance, a moving target detection and tracking system was designed and implemented in this study. Given the restrictions presented by the amphibious environment and the small-sized spherical amphibious robot, an industrial camera and vision algorithms using adaptive appearance models were adopted to construct the proposed system. To handle the problem of light scattering and absorption in the underwater environment, the multi-scale retinex with color restoration algorithm was used for image enhancement. Given the environmental disturbances in practical amphibious scenarios, the Gaussian mixture model was used to detect moving targets entering the field of view of the robot. A fast compressive tracker with a Kalman prediction mechanism was used to track the specified target. Considering the limited load space and the unique mechanical structure of the robot, the proposed vision system was fabricated with a low power system-on-chip using an asymmetric and heterogeneous computing architecture. Experimental results confirmed the validity and high efficiency of the proposed system. The design presented in this paper is able to meet future demands of spherical amphibious robots in biological monitoring and multi-robot cooperation.

Preliminary study of abnormalities in saccade dynamics in patients with hyperthyroidism with no pre‑existing eye damage

“…Eye movement processes require central generators, nerve conduction systems and eye movement systems. These processes are reflected in technologies that are widely used in industry, mechanical manufacturing and human engineering (23). In medicine, eye-tracking systems are mainly applied in neuropsychology and ophthalmology research (24).…”

A Multiplicative Noises and Additive Correlated Noises Cubature Kalman Filter and Its Application in Quadruped Robot

“…It can be seen that the two hypotheses of KF theory are quite ideal, which can hardly be met in the actual system. In the fields such image information processing [5], pattern recognition [6], underwater target tracking [7], aircraft tracking [8], space target tracking [9], and robot state estimation [10], there exists another type of non-ideal circumstances that in the process of signal transmission, there will be delay, distortion, attenuation or channel interference, the random uncertainty of system model parameters will be caused by modeling error, model simplification and random disturbance, the ranging noise of the sensor varies with the increase of the distance and appears as multiplicity noise [11]. These circumstances cannot be indicated by additive noise in classical systems.…”

Hydrodynamic Analysis-Based Modeling and Experimental Verification of a New Water-Jet Thruster for an Amphibious Spherical Robot

“…Amphibious robots have attracted increasing attention from researchers for various applications in complex environments [1]. They can be applied to pollution detection, terrain mapping, and for scouting potential approach lanes for amphibious naval operations in constricted areas [2,3,4]. The propulsion systems of amphibious robots play a vital role in achieving these wide applications in complex environments [5].…”