Although uncertainty is inherent in weather forecasts, explicit numeric uncertainty estimates are rarely included in public forecasts for fear that they will be misunderstood. Of particular concern are situations in which precautionary action is required at low probabilities, often the case with severe events. At present, a categorical weather warning system is used. The work reported here tested the relative benefits of several forecast formats, comparing decisions made with and without uncertainty forecasts. In three experiments, participants assumed the role of a manager of a road maintenance company in charge of deciding whether to pay to salt the roads and avoid a potential penalty associated with icy conditions. Participants used overnight low temperature forecasts accompanied in some conditions by uncertainty estimates and in others by decision advice comparable to categorical warnings. Results suggested that uncertainty information improved decision quality overall and increased trust in the forecast. Participants with uncertainty forecasts took appropriate precautionary action and withheld unnecessary action more often than did participants using deterministic forecasts. When error in the forecast increased, participants with conventional forecasts were reluctant to act. However, this effect was attenuated by uncertainty forecasts. Providing categorical decision advice alone did not improve decisions. However, combining decision advice with uncertainty estimates resulted in the best performance overall. The results reported here have important implications for the development of forecast formats to increase compliance with severe weather warnings as well as other domains in which one must act in the face of uncertainty.
Each of us makes important decisions involving uncertainty in domains in which we are not experts, such as retirement planning, medical treatment, and precautions against severe weather. Often, reliable information about uncertainty is available to us, although how effectively we incorporate it into the decision process remains in question. Previous research suggests that people are error-prone when reasoning with probability. However, recent research in weatherrelated decision making is more encouraging. Unlike earlier work that compares people's decisions with a rational standard, this research compares decisions made by people with and without uncertainty information. The results suggest that including specific numeric uncertainty estimates in weather forecasts increases trust and gives people a better idea of what to expect in terms of both the range of possible outcomes and the amount of uncertainty in the particular situation, all of which benefit precautionary decisions. However, the advantage for uncertainty estimates depends critically on how they are expressed. It is crucial that the expression is compatible with both the decision task and cognitive processes of the user.
Despite improvements in forecasting extreme weather events, noncompliance with weather warnings among the public remains a problem. Although there are likely many reasons for noncompliance with weather warnings, one important factor might be people's past experiences with false alarms. The research presented here explores the role of false alarms in weather-related decision making. Over a series of trials, participants used an overnight low temperature forecast and advice from a decision aid to decide whether to apply salt treatment to a town's roads to prevent icy conditions or take the risk of withholding treatment, which resulted in a large penalty when freezing temperatures occurred. The decision aid gave treatment recommendations, some of which were false alarms, i.e., treatment was recommended but observed temperatures were above freezing. The rate at which the advice resulted in false alarms was manipulated between groups. Results suggest that very high and very low false alarm rates led to inferior decision making, but that lowering the false alarm rate slightly did not significantly affect compliance or decision quality. However, adding a probabilistic uncertainty estimate in the forecasts improved both compliance and decision quality. These findings carry implications about how weather warnings should be communicated to the public.
Lingering skepticism about climate change might be due in part to the way climate projections are perceived by members of the public. Variability between scientists' estimates might give the impression that scientists disagree about the fact of climate change rather than about details concerning the extent or timing. Providing uncertainty estimates might clarify that the variability is due in part to quantifiable uncertainty inherent in the prediction process, thereby increasing people's trust in climate projections. This hypothesis was tested in two experiments. Results suggest that including uncertainty estimates along with climate projections leads to an increase in participants' trust in the information. Analyses explored the roles of time, place, demographic differences (e.g., age, gender, education level, political party affiliation), and initial belief in climate change. Implications are discussed in terms of the potential benefit of adding uncertainty estimates to public climate projections.
What is the best way to communicate the risk of rare but extreme weather to the public? One suggestion is to communicate the relative risk of extreme weather in the form of odds ratios; but, to the authors’ knowledge, this suggestion has never been tested systematically. The experiment reported here provides an empirical test of this hypothesis. Participants performed a realistic computer simulation task in which they assumed the role of the manager of a road maintenance company and used forecast information to decide whether to take precautionary action to prevent icy conditions on a town’s roads. Participants with forecasts expressed as odds ratios were more likely to take appropriate precautionary action on a single target trial with an extreme low temperature forecast than participants using deterministic or probabilistic forecasts. However, participants using probabilistic forecasts performed better on trials involving weather within the normal range than participants with only deterministic forecast information. These results may provide insight into how best to communicate extreme weather risk. This paper offers clear evidence that people given relative risk information are more inclined to take precautionary action when threatened with an extreme weather event with a low probability than people given only single-value or probabilistic forecasts.
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.
customersupport@researchsolutions.com
10624 S. Eastern Ave., Ste. A-614
Henderson, NV 89052, USA
This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.
Copyright © 2025 scite LLC. All rights reserved.
Made with 💙 for researchers
Part of the Research Solutions Family.