The false alarm rate (FAR) measures the fraction of forecasted events that did not occur, and it remains one of the key metrics for verifying National Weather Service (NWS) weather warnings. The national FAR for tornado warnings in 2003 was 0.76, indicating that only one in four tornado warnings was verified. The NWS's goal for 2010 is to reduce this value to 0.70. Conventional wisdom is that false alarms reduce the public's willingness to respond to future events. This paper questions this conventional wisdom. In addition, this paper argues that the metrics used to evaluate false alarms do not accurately represent the numbers of actual false alarms or the forecasters' abilities because current metrics categorize events as either a hit or a miss and do not give forecasters credit for close calls. Aspects discussed in this paper include how the NWS FAR is measured, how humans respond to warnings, and what are alternative approaches to measure FAR. A conceptual model is presented as a framework for a new perspective on false alarms that includes close calls, providing a more balanced view of forecast verification.
Two items need to be clarified from an earlier work of the authors. The first is that the layout of the 2 3 2 contingency table was reversed from standard practice, with
One of the goals of the Warning Project is to understand how people receive warnings of hazardous weather and subsequently use this information to make decisions. As part of the project, 519 surveys from Austin, Texas, floodplain residents were collected and analyzed. About 90% of respondents understood that a tornado warning represented a more serious and more likely threat than a tornado watch. Most respondents (86%) were not concerned about a limited number of false alarms or close calls reducing their confidence in future warnings, suggesting no cry-wolf effect. Most respondents reported safe decisions in two hypothetical scenarios: a tornado warning issued while the respondent was home and a tornado visible by the respondent while driving. However, nearly half the respondents indicated that they would seek shelter from a tornado under a highway overpass if they were driving. Despite the limitations of this study, these results suggest that more education is needed on the dangers of highway overpasses as shelter from severe weather.
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.