Optical-Electronic Device of Calculation of Parameters of Volume Objects of Working Scene at Multiple Sources of Video Data

Abstract

The paper considers approaches to the construction of a geographically distributed optical-electronic device, providing an analysis of significant and long working scenes in the interests of automating the processes of control and management of robotic tools in industrial assembly shops and warehouses. The principal difference of the proposed solution is the possibility of obtaining images of the analyzed objects using optical-electronic sensors located in different parts of the workspace to realize the function of binocular vision on a much larger area of the working scene compared to analogues. A distinctive novelty of the developed theoretical approach is the approach to binocular technical vision, which consists in iteratively performing calibration procedures for selected pairs of opticalelectronic sensors and the subsequent calculation of the spatial coordinates of the objects being analyzed using calibrated pairs of optical-electronic sensors. The results of image analysis from each of the optoelectronic sensors are used to accompany moving objects and analyze their motion paths in the working scene space. To implement the developed theoretical approaches, a modular optoelectronic device has been developed, consisting of two types of modules. The first type of module is a standalone opto-electronic module, which includes an opto-electronic sensor and means for processing and extracting primary features immediately upon receiving images for their subsequent analysis. The second type is a computational module that provides processing of primary data from a set of modules of the first type. Data transfer between device modules is provided via radio over a WiFi network. A distinctive feature of the developed device is the primary processing of images immediately upon their receipt and transmission over the radio channel of a small amount of data about the selected objects to the computing module, which performs the final stages of data processing and generates a set of parameters describing the characteristics and spatial coordinates of the objects found on the working scene for their further of use. Experimental studies were conducted on the developed simulation model, which confirmed the correctness of the developed theoretical approach and the possibility of its application in practice.