A comparative evaluation of objective and subjective weather forecasts in the united states

Abstract

This paper is concerned primarily with the evaluation and comparison of objective and subjective weather forecasts. Operational forecasts of three weather elements are considered: ( I ) probability forecasts of precipitation occurrence, (2) categorical (i.e. non-probabilistic) forecasts of maximum and minimum temperatures and (3) categorical forecasts of cloud amount. The objective forecasts are prepared by numerical-statistical procedures, whereas the subjective forecasts are based on the judgements of individual forecasters. In formulating the latter, the forecasters consult information from a variety of sources, including the objective forecasts themselves. The precipitation probability forecasts are found to be both reliable and skilful, and evaluation of the temperature/cloud amount forecasts reveals that they are quite accurate/skilful. Comparison of the objective and subjective forecasts of precipitation occurrence indicates that the latter are generally more skilful than the former for shorter lead times (e.g. 12-24 hours), whereas the two types of forecasts are of approximately equal skill for longer lead times (e.g. 3 6 4 8 hours). Similar results are obtained for the maximum and minimum temperature forecasts. Objective cloud amount forecasts are more skilful than subjective cloud amount forecasts for all lead times. Examination of trends in performance over the last decade reveals that both types of forecasts for all three elements increased in skill (or accuracy) over the period, with improvements in objective forecasts equalling or exceeding improvements in subjective forecasts. The role and impact of the objective forecasts in the subjective weather forecasting process are discussed in some detail. The need to conduct controlled experiments and other studies of this process, with particular reference to the assimilation of information from different sources, is emphasized. Important characteristics of the forecasting system in meteorology are identified, and they are used to describe similarities and differences between weather forecasting and forecasting in other fields. Acquisition of some of these characteristics may be beneficial to other forecasting systems. KEY WORDS

On the Trend Recognition and Forecasting Ability of Professional Traders

“…Koehler et al 2002), although some exceptions exist, such as the calibration of weather forecasters Brown 1984 andWinkler 1984).…”

How Convergence of Research Paradigms Can Improve Research on Diagnostic Judgment

“…(There are some researchers who make use of both metatheories, although not in the same study. [9][10][11][12][13] The broad conclusion drawn by the correspondence researchers is that cognitive competence (which they define as empirical accuracy) is widespread among species-Homo sapiens includedbut, in general, task conditions can degrade accuracy, and, in particular, conditions under which physicians work can degrade the accuracy of diagnostic judgment. Therefore, physicians need to know which conditions have these effects, and why, and judgment and decision researchers and physicians should collaborate in the effort to discover these.…”

Lie-Detection Biases among Male Police Interrogators, Prisoners, and Laypersons

“…Earlier studies of overconfidence showed that corrective feedback on weather forecasting (Murphy & Brown, 1984) and on the game of bridge (Keren, 1987) moderated overconfidence. It was, therefore, hypothesized that although surviving in an environment of deception and mistrust may enhance lying skills (telling and detecting), prisoners would rate their own skills as inferior to those of police interrogators.…”