Parallel heterogeneous data‐fusion convolutional neural networks for improved rail bridge strike detection

Abstract

Low clearance rail bridges provide vital crossings for freight and passenger trains and are susceptible to frequent strikes from overheight vehicles or equipment. Impact detection systems can help ensure the safety of railroad bridges and their users; such systems streamline monitoring efforts by providing near real‐time strike notifications to rail managers responsible for assessing a bridge after a strike. This paper develops parallel heterogeneous data‐fusion convolutional neural networks (PHD‐CNN) operating on data collected from in‐service rail bridges that improves detection and classification of from overheight vehicles. Convolutional neural networks (CNNs) automatically extract features from multiple data streams from different sensor modalities. The method provides a mechanism to homogenize and fuse disparate data streams for use as inputs to a classifier that distinguishes bridge strikes from passing trains. The study also provides practical implementation guidelines through a framework sensitivity characterization to examine the effects on performance of input data stream type, data set size, and CNN architecture complexity. Optimum networks detect, on average, 95% of bridge strikes with false positive rates less than 2%.