In Search of a Modus Operandi for Evaluation: Developing a Mixed-Methods Approach for Crisis Team Exercises

Abstract

In recent years, there has been an increase in critical situations such as crisis and disasters in Germany. Due to the country's low-crisis history and the predominance of blue-light organizations like the police and fire departments in managing disasters, these circumstances affect other organizations, such as public administrations, that have had less contact with crisis management, sometimes unexpectedly. This is illustrated by examples such as the refugee situation in 2015/2016 and the COVID-19 pandemic. One way to prepare is through exercises in crisis management and, more specifically, staff work. The demand for these therefore also seems to be increasing in administrations. This article presents an evaluation approach for such exercises based on an example of a staff exercise in Germany. It describes the developed evaluation approach, discusses some exemplary results in relation to the topic of communication and the potential of a partially standardized evaluation. Finally, the article discusses the extent to which a multi-method approach to exercise evaluation, which works with a standard framework but also leaves scope for individual adaptation, contains practical and scientific added values.