1-D Convolutional Neural Networks for Signal Processing Applications

Abstract

During the last decade, Convolutional Neural Networks (CNNs) have become the de facto standard for various Computer Vision and Machine Learning operations. CNNs are feed-forward Artificial Neural Networks (ANNs) with alternating convolutional and subsampling layers. Deep 2D CNNs with many hidden layers and millions of parameters have the ability to learn complex objects and patterns providing that they can be trained on a massive size visual database with ground-truth labels. With a proper training, this unique ability makes them the primary tool for various engineering applications for 2D signals such as images and video frames. Yet, this may not be a viable option in numerous applications over 1D signals especially when the training data is scarce or application-specific. To address this issue, 1D CNNs have recently been proposed and immediately achieved the state-of-the-art performance levels in several applications such as personalized biomedical data classification and early diagnosis, structural health monitoring, anomaly detection and identification in power electronics and motor-fault detection. Another major advantage is that a real-time and low-cost hardware implementation is feasible due to the simple and compact configuration of 1D CNNs that perform only 1D convolutions (scalar multiplications and additions). This paper presents a comprehensive review of the general architecture and principals of 1D CNNs along with their major engineering applications, especially focused on the recent progress in this field. Their state-of-the-art performance is highlighted concluding with their unique properties. The benchmark datasets and the principal 1D CNN software used in those applications are also publically shared in a dedicated website.

Detection of Gait Abnormalities for Fall Risk Assessment Using Wrist-Worn Inertial Sensors and Deep Learning

“…The number of filters and their size are the crucial hyper-parameters that should be determined for the convolutional layers. When one-dimensional convolutional layers are considered [ 38 ], the convolution operation between the filter and the input data outputs a single scalar value. Moving the filter along the input sequence generates the feature vector after each convolutional layer.…”

Structural damage detection using hybrid deep learning algorithm

“…The hyperparameters of a 1D convolution layer comprise the number of kernels, the kernel length, and the stride value. The formula of one typical convolutional layer is expressed as follows [15]:…”

1D Convolutional Neural Networks Versus Automatic Classifiers for Known LPI Radar Signals Under White Gaussian Noise

“…The details of both 1D forward propagation (1D-FP) and Back-Propagation (BP) are detailed in Appendix A. For further details, the Readers are encouraged to refer to the comprehensive survey in [33] and [34].…”

“…Moreover, when the data is scarce, in order to prevent over-fitting and poor generalization deep (2D) CNNs usually require certain techniques such as data augmentation and Dropout, which not only increases the computational complexity and training, they may not address these issues completely. Therefore, in this study, we propose to use compact 1D CNNs that can directly be applied to the received data signal without any pre-processing and they allow real-time implementation even on low-power devices due to their elegant computational efficiency [33], [34]. Our third approach is based on spectral-domain features of the radar signals received by the ESM system.…”