Development of Agent Logic Programming Means for Multichannel Intelligent Video Surveillance

Morozov, Alexei A.; Sushkova, Olga S.; Petrova, Nadezhda G.; Khokhlova, Margaret N.; Migniot, Cyrille

doi:10.17725/rensit.2018.10.101

Cited by 4 publications

(3 citation statements)

References 25 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…The KinectBuffer built-in class acquires 3D video data from the time-of-flight camera of the Kinect 2 device (Microsoft Inc). The reading and recording of 3D video data files are also supported [28]. The following essential functions are implemented in the KinectBuffer class:…”

Section: Semantic Fusion Of Heterogeneous Video Imagesmentioning

confidence: 99%

Development of a Method of Terahertz Intelligent Video Surveillance Based on the Semantic Fusion of Terahertz and 3D Video Images

Morozov

Sushkova

Kershner

et al. 2019

Proceedings of the v International Conference Information Technology and Nanotechnology 2019

View full text Add to dashboard Cite

The terahertz video surveillance opens up new unique opportunities in the field of security in public places, as it allows to detect and thus to prevent usage of hidden weapons and other dangerous items. Although the first generation of terahertz video surveillance systems has already been created and is available on the security systems market, it has not yet found wide application. The main reason for this is in that the existing methods for analyzing terahertz images are not capable of providing hidden and fully-automatic recognition of weapons and other dangerous objects and can only be used under the control of a specially trained operator. As a result, the terahertz video surveillance appears to be more expensive and less efficient in comparison with the standard approach based on the organizing security perimeters and manual inspection of the visitors. In the paper, the problem of the development of a method of automatic analysis of the terahertz video images is considered. As a basis for this method, it is proposed to use the semantic fusion of video images obtained using different physical principles, the idea of which is in that the semantic content of one video image is used to control the processing and analysis of another video image. For example, the information about 3D coordinates of the body, arms, and legs of a person can be used for analysis and proper interpretation of color areas observed on a terahertz video image. Special means of the object-oriented logic programming are developed for the implementation of the semantic fusion of the video data, including special built-in classes of the Actor Prolog logic language for acquisition, processing, and analysis of video data in the visible, infrared, and terahertz ranges as well as 3D video data.

show abstract

Section: Semantic Fusion Of Heterogeneous Video Imagesmentioning

confidence: 99%

Development of a Method of Terahertz Intelligent Video Surveillance Based on the Semantic Fusion of Terahertz and 3D Video Images

Morozov

Sushkova

Kershner

et al. 2019

Proceedings of the v International Conference Information Technology and Nanotechnology 2019

View full text Add to dashboard Cite

show abstract

“…For calibration, a standard chessboard pattern measuring 7x10 cells was used, the cell size was 25x25 mm. Dark cells of the board are made of aluminum foil, as this same calibration board is used for thermal imaging [69].…”

Section: Calibration Of the Measuring Systemmentioning

confidence: 99%

“…This class is designed to receive data from the time-of-flight camera of the Kinect 2 device, and also to record and read the created 3D video. A detailed description of the built-in KinectBuffer class can be found in [69].…”

Section: Experimental Softwarementioning

confidence: 99%

Semantic Fusion and Joint Analysis of Terahertz and 3d Video Images by the Means of Object-Oriented Logic Programming

Morozov¹,

Sushkova²,

Polupanov³

et al. 2018

RENSIT

Self Cite

View full text Add to dashboard Cite

The aim of the work is to create methods and software tools for the terahertz range intelligent video surveillance, that is, for automatic analysis of video images in the terahertz frequency range. Terahertz video surveillance provides unique prospects in the area of public safety; in particular, it allows you to remotely identify weapons and dangerous items hidden under clothing on the human body. However, such characteristics of terahertz video, as low resolution, low contrast, and low signal-to-noise ratio, lead to the need to develop new methods and approaches to automatic video analysis. To understand the terahertz video image, the operator of the industrial video surveillance system usually compares it with images in other frequency ranges (visible or infrared). The comparison of these images of different types helps the operator to interpret the colored and/ or one-color spots in the terahertz image in a proper way. In terms of automatic video analysis, this means that the context of the observed events and objects is taken into account, or in other words, a semantic fusion is implemented of the terahertz range video image with video images of other frequency ranges, e.g., near-infrared, visible, etc. The authors consider the semantic fusion of the video images as a critical component of the prospective terahertz intelligent video surveillance technology. A new method of the terahertz video surveillance based on the fusion of the terahertz video with 3D video is proposed. The means of the object-oriented logic programming developed for the semantic fusion of the terahertz and 3D video images are described. The developed method provides a real-time fusion of the terahertz video acquired using the THERZ-7A (Astrohn Technology Ltd) subterahertz scanning device (0.23-0.27 THz) and 3D video data acquired using the Kinect 2 (Microsoft Inc) time-of-flight sensor. The method and software tools for the semantic fusion of the terahertz and 3D video images are developed.

show abstract

Development of a Publicly Available Terahertz Video Dataset and a Software Platform for Experimenting with the Intelligent Terahertz Visual Surveillance

Morozov

Sushkova

2020

Advances in Intelligent Systems and Computing

View full text Add to dashboard Cite

Development of Agent Logic Programming Means for Multichannel Intelligent Video Surveillance

Cited by 4 publications

References 25 publications

Development of a Method of Terahertz Intelligent Video Surveillance Based on the Semantic Fusion of Terahertz and 3D Video Images

Development of a Method of Terahertz Intelligent Video Surveillance Based on the Semantic Fusion of Terahertz and 3D Video Images

Semantic Fusion and Joint Analysis of Terahertz and 3d Video Images by the Means of Object-Oriented Logic Programming

Development of a Publicly Available Terahertz Video Dataset and a Software Platform for Experimenting with the Intelligent Terahertz Visual Surveillance

Contact Info

Product

Resources

About