Forecast Combination under Heavy-Tailed Errors

Abstract

Forecast combination has been proven to be a very important technique to obtain accurate predictions for various applications in economics, finance, marketing and many other areas. In many applications, forecast errors exhibit heavy-tailed behaviors for various reasons. Unfortunately, to our knowledge, little has been done to obtain reliable forecast combinations for such situations. The familiar forecast combination methods, such as simple average, least squares regression or those based on the variance-covariance of the forecasts, may perform very poorly due to the fact that outliers tend to occur, and they make these methods have unstable weights, leading to un-robust forecasts. To address this problem, in this paper, we propose two nonparametric forecast combination methods. One is specially proposed for the situations in which the forecast errors are strongly believed to have heavy tails that can be modeled by a scaled Student's t-distribution; the other is designed for relatively more general situations when there is a lack of strong or consistent evidence on the tail behaviors of the forecast errors due to a shortage of data and/or an evolving data-generating process. Adaptive risk bounds of both methods are developed. They show that the resulting combined forecasts yield near optimal mean forecast errors relative to the candidate forecasts. Simulations and a real example demonstrate their superior performance in that they indeed tend to have significantly smaller prediction errors than the previous combination methods in the presence of forecast outliers.

Detangling robustness in high dimensions: composite versus model-averaged estimation

“…Model averaging enjoys a wide application, see, for example, the recent overview paper for model averaging in ecology by Dormann et al (2018) and for application to hydrology by Hge et al (2019). In econometrics, the terminology "forecast combinations" appears (e.g., in Cheng et al, 2015;Bates and Granger, 1969); whereas "multimodel inference" is another commonly used term for this procedure (Burnham and Anderson, 2002).…”