Dynamic scene classification using convolutional neural networks

Abstract

The task of classifying videos of natural dynamic scenes into appropriate classes has gained lot of attention in recent years. The problem especially becomes challenging when the camera used to capture the video is dynamic. In this paper, we analyse the performance of statistical aggregation (SA) techniques on various pre-trained convolutional neural network(CNN) models to address this problem.The proposed approach works by extracting CNN activation features for a number of frames in a video and then uses an aggregation scheme in order to obtain a robust feature descriptor for the video. We show through results that the proposed approach performs better than the-state-of-the arts for the Maryland and YUPenn dataset. The final descriptor obtained is powerful enough to distinguish among dynamic scenes and is even capable of addressing the scenario where the camera motion is dominant and the scene dynamics are complex.Further, this paper shows an extensive study on the performance of various aggregation methods and their combinations. We compare the proposed approach with other dynamic scene classification algorithms on two publicly available datasets -Maryland and YUPenn to demonstrate the superior performance of the proposed approach.

Tensor Matched Kronecker-structured Subspace Detection for Missing Information

“…These available methods make an implicit assumption that the signal is present in vectorized form and convert a multi-dimensional signal into a single dimension before testing. Many real-world signals such as dynamic scene video [11] or tomographic images are inherently multi dimensional, which capture the spatial and temporal correlations within the data. However, by vectorizing the signal we lose the multi-dimensional structure of the data, which could be used to enhance the performance of the detector.…”

A Review of Deep Learning Methods and Applications for Unmanned Aerial Vehicles

“…In the robotics field, feature extraction systems based on CNN models have been mainly applied for object recognition [42][43][44][45][46][47][48] and scene classification [51][52][53][54]. Concerning the object recognition task, recent advances have integrated object detection solutions by means of bounding box regression and object classification capabilities within the same CNN model [42][43][44].…”