Gun muzzle flash detection using a single photon avalanche diode array in 0.18µm CMOS technology

Savuskan, Vitali; Jakobson, C.G.; Merhav, Tomer; Shoham, A.; Brouk, Igor; Nemirovsky, Y.

doi:10.1117/12.2180334

Cited by 5 publications

(1 citation statement)

References 3 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…2,5,6 Recent works have focused on the use of single-photon avalanche diode (SPAD) arrays in the detection of gunfire through characteristic potassium emission lines at the 766nm and 769nm wavelengths of the muzzle flash. [7][8][9] The use of an array paired with a calibrated imaging camera allows for very precise and accurate line-of-sight localization in 3D space of the detected gunshot over a wide field-of-view (FOV).…”

Section: Introductionmentioning

confidence: 99%

Expandable SPAD-based real-time gun muzzle flash localization system using FPGAs and deep-learning

Chia

Motani

2023

Pattern Recognition and Tracking XXXIV

View full text Add to dashboard Cite

Gun muzzle flash produces characteristic signatures on the 766nm and 769nm wavelengths that can be passively picked up from a distance using ultra-sensitive SPAD arrays for immediate localization. Sifting through the massive number of pulses generated by the arrays in real-time however poses a challenge, especially when deep-learning models are used for classification. We present a novel FPGA-based expandable system consisting of a two-tier detection architecture that decouples the computationally-intensive deep-learning model from the data rate intensive SPAD arrays. Our slope-based first tier algorithm provides an FPGA-efficient first-look filter and our ResNet-based deep-learning model provides high sensitivity across different lighting conditions while maintaining high specificity in the face of potential false positives in an urban environment. The deep-learning model was trained with synthetic datasets generated from small samples of gun muzzle flashes from various weapons and ammunition types available to us, and sources of likely false positives in an urban environment. In testing, our system achieves a detection rate of 99.8%, 99.9% specificity and 99.6% sensitivity for shots fired from distances between 50 to 450m.

show abstract