RTAIAED: a Real-Time Ambulance in an Emergency Detector with a Pyramidal Part-Based Model composed of MFCCs and YOLOv8

Abstract

In emergency situations, every second counts for an ambulance navigating through traffic. Efficient use of traffic light systems can play a crucial role in minimizing response time. This paper introduces a novel automated Real-Time Ambulance in an Emergency Detector (RTAIAED). The proposed system uses special Lookout Stations (LS) suitably positioned at a certain distance from each involved traffic light (TL), to obtain timely and safe transitions to green lights as the Ambulance in an Emergency (AIAE) approaches. The RTAIAED is particularly pertinent on one-way roads, addressing the challenge of regulating the sequence of traffic-lights-signals so as to minimize the time needed to safely grant the green signal to the AIAE. The proposed solution leverages a part-based model made of elementary detectors for video analysis, specifically realized with a customized YOLOv8 model, and for audio analysis, thanks to an additional neural network based on Mel Frequency Cepstral Coefficients (MFCCs). This way, the RTAIAED ensures the accurate and robust identification of an AIAE heading towards a traffic light in time to ensure a green light thanks to the strategic positioning of the LS detectors. Extensive experiments demonstrate the robustness of the approach and its reliable application in real-world scenarios thanks to its predictions in real-time, showcasing the ability to detect AIAEs even in challenging conditions such as noisy environments, nighttime, or adverse weather conditions, provided a suitable-quality camera is appropriately positioned. The proposed system can also find application in traffic flow management.