Expert Panels in Evaluation: An Update From the Field Using the DATA Model

Abstract

In this practice note, the authors reflect on the use and utility of expert panels in evaluation. They apply the describe, analyze, theorize, act model using interviews with evaluators, insights from peer-reviewed literature and their own professional observations. Connections are made to larger evaluation discourses regarding reflection, expert opinion, expertise, epistemic authority, and lived experience. It was found that expert panels are generally underutilized in evaluation due to a lack of awareness among evaluators as well as the perceived complexity associated with this method. However, the literature and interviews were clear that, when managed properly, expert panels can add tremendous value to an evaluation. There is therefore merit for more seriously considering panels in future evaluations. This note provides recommendations for evaluators and the evaluation community at large.