Addressing data scarcity using audio signal augmentation and deep learning for bolt looseness prediction

Abstract

Deep learning models such as convolutional neural networks (CNNs) encounter challenges, including instability and overfitting, while predicting bolt looseness in data-scarce scenarios. In this study, we proposed a novel audio signal augmentation approach to classify bolt looseness in the event of data deficiency using CNN models. Audio signals at varied bolt torque conditions were extracted using the percussion method. Audio signal augmentation was performed using signal shifting and scaling strategies after segmenting the extracted audio signals. The unaugmented and augmented audio signals were transformed into scalograms using the continuous wavelet transform approach to train the CNN models. Upon training with augmented datasets, a promising improvement in the loss and accuracy of the CNN models in recognizing bolt looseness was noticed. One of the significant observations from the current study is that the implementation of audio signal augmentation improved the extrinsic generalization ability of the CNN models to classify bolt looseness. A maximum increase of 73.5% to identify bolt looseness in novel data was exhibited as compared to without augmentation. Overall, a maximum accuracy of 94.5% to classify bolt looseness in unseen data was demonstrated upon audio signal augmentation. In summary, the results affirm that the audio signal augmentation approach empowered the CNN models to predict bolt looseness in data-deficient scenarios accurately.