Motivated by the growing interest of investors in commodities and by advances in risk measurement, we present a full‐scale analysis of expected shortfall (ES) in commodity futures markets. Besides illustrating the dynamics of historic ES, we evaluate whether popular estimators are suitable for forecasting future ES. By implementing a new backtest, we find that the performance of estimators hinges on market stability. Estimators tend to fail when markets are in turmoil and accurate forecasts are urgently needed. Even though a kernel method performs best on average, our results advise against the use of established estimators for risk (and margin) prediction.
Purpose
Motivated by the growing importance of the expected shortfall in banking and finance, this study aims to compare the performance of popular non-parametric estimators of the expected shortfall (i.e. different variants of historical, outlier-adjusted and kernel methods) to each other, selected parametric benchmarks and estimates based on the idea of forecast combination.
Design/methodology/approach
Within a multidimensional simulation setup (spanned by different distributional settings, sample sizes and confidence levels), the authors rank the estimators based on classic error measures, as well as an innovative performance profile technique, which the authors adapt from the mathematical programming literature.
Findings
The rich set of results supports academics and practitioners in the search for an answer to the question of which estimators are preferable under which circumstances. This is because no estimator or combination of estimators ranks first in all considered settings.
Originality/value
To the best of their knowledge, the authors are the first to provide a structured simulation-based comparison of non-parametric expected shortfall estimators, study the effects of estimator averaging and apply the mentioned profiling technique in risk management.
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.