Text Mining the Contributors to Rail Accidents

Abstract

Rail accidents represent an important safety concern for the transportation industry in many countries. In the 11 years from 2001 to 2012, the U.S. had more than 40 000 rail accidents that cost more than $45 million. While most of the accidents during this period had very little cost, about 5200 had damages in excess of $141 500. To better understand the contributors to these extreme accidents, the Federal Railroad Administration has required the railroads involved in accidents to submit reports that contain both fixed field entries and narratives that describe the characteristics of the accident. While a number of studies have looked at the fixed fields, none have done an extensive analysis of the narratives. This paper describes the use of text mining with a combination of techniques to automatically discover accident characteristics that can inform a better understanding of the contributors to the accidents. The study evaluates the efficacy of text mining of accident narratives by assessing predictive performance for the costs of extreme accidents. The results show that predictive accuracy for accident costs significantly improves through the use of features found by text mining and predictive accuracy further improves through the use of modern ensemble methods. Importantly, this study also shows through case examples how the findings from text mining of the narratives can improve understanding of the contributors to rail accidents in ways not possible through only fixed field analysis of the accident reports.Index Terms-Rail safety, safety engineering, latent Dirichlet allocation, partial least squares, random forests. 1524-9050

Opinion Mining on Social Media Transit Tweets using Text Pre-Processing and Machine Learning Techniques

“…[14] Proposed a methodology that explores the abilities to make use of geotagged social media twitter data and investigate the longitudinal travel behavior analysis. [15] [16] Presented an approach that integrates the text mining techniques and ensemble methods which increases the performance of models for predicting the severity of rail accidents. [17] Explores the prediction of transportation sentiment classification using Instagram social media features.…”

“… A methodology of text mining with a combination of techniques to automatically detect the accident severity is [16] presented. It requires probabilistic models for assessing accident severity.…”

An exploration of text mining of narrative reports of injury incidents to assess risk

“…Text mining of narrative reports about industrial injury incidents is not a new approach. For example, text mining has been applied to narrative descriptions of railroad accidents [8], farm tractor fatalities [9], nail gun injuries in construction [10], and in many other studies of industrial injury epidemiology [11]. In some cases, narratives are referenced in reports to add contextual information to explain injury correlates that initially were identified through quantitative relationships among characteristics of miner injuries [12].…”

RKE-CP: Response-based Knowledge Extraction from Collaborative Platform of Text-based Communication

“…The study outcome was testified using vector length, size of corpus, and iteration. Brown [16] has carried out a study about implying potential of using text mining in order to investigate probabilities of rail accidents. Aggarwal et al [17] have discussed over using an algorithm in order to develop a clustering mechanism.…”