Inertial sensor for an autonomous data acquisition of a novel automotive acoustic measurement system

Masino, Johannes; Luh, Matthias; Frey, Michael; Gauterin, Frank

doi:10.1109/isiss.2017.7935649

Cited by 1 publication

(1 citation statement)

References 7 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…The algorithm is deployed on an electronic board mounted on the rim flange of a vehicle, linked to a microphone that is installed inside the tyre cavity and equipped with components for Bluetooth Low Energy (BLE) data transmission. One of the main differences between the system proposed by Masino et al [19] and the system proposed in this work is that here the classification is executed real-time directly on the microcontroller. Another innovative aspect is the employment of a convolution neural network that receives Mel spectrogram as input and classifies the road health.…”

Section: B Our Contributionmentioning

confidence: 99%

An Embedded System for Acoustic Data Processing and AI-Based Real-Time Classification for Road Surface Analysis

2022

View full text Add to dashboard Cite

The current roadway monitoring is expensive and not systematic. This paper proposes a new system able to evaluate the pavement quality of road infrastructure. The embedded system records and processes the acoustic data of the wheel-road interaction and classifies in real-time roadways' health thanks to integrated AI solutions. The measurements to produce the dataset to train a convolutional neural network (CNN) were collected using a vehicle operating at different cruise speeds in the area of Pisa. The dataset is composed by acoustic data belonging to several typologies of roads: dirty or grass roads, high roughness surfaces and roads with cracks or potholes. The raw audio signals were split, labelled, and converted into images by calculating the Mel spectrogram. Finally, the authors designed a tiny CNN with a size equal to 18 kB able to classify between four different classes: good quality road, ruined road, silence and unknown. The CNN architecture achieves an accuracy of about 93% on the original model and 90% on the quantized one. Quantization permits to convert the final architecture into a suitable form to be deployed on a low-complex embedded system integrated in the tyre cavity. In addition, a custom board was designed to act as IoT node thanks to a Bluetooth Low Energy communication towards smartphones and/or car infotainment systems. These systems, featured with GPS, guarantee to obtain real-time maps service of road quality. At authors' knowledge, this is the first real-time and fully integrated solution at the state of the art for road pavement quality analysis and classification on acoustic data.INDEX TERMS road surface classification; convolutional neural network; audio processing; embedded system; image recognition.

show abstract

Section: B Our Contributionmentioning

confidence: 99%