Introducing Q Methodology to Program Evaluators

Abstract

This method note presents Q methodology as a useful tool for evaluators to add to their practice toolbox. Q methodology, which involves both quantitative and qualitative techniques, can help researchers and evaluators systematically understand subjectivity and the communicability of opinions and perspectives. We first provide an overview of Q methodology, followed by a brief summary of how evaluators are using Q, and an explanation of the steps for implementing Q methodology. Either by itself or with other methods, the potential uses of Q methodology in evaluation are diverse. For practical demonstration, we describe how Q methodology was used in a recent evaluation in the UK to understand stakeholder subjectivity within the program. We then reflect upon the pros and cons of using Q in program evaluation, concluding that it constitutes a worthwhile tool for evaluating complex programs.

Medical student and trainee doctor views on the ‘good’ doctor: Deriving implications for training from a Q-methods study

“…Q-methodology is designed to capture the subjective viewpoints of individuals in a systematic manner, such that groupings of similar viewpoints can by identified using statistical techniques (Steven 1993, Watts and Stenner 2005, Cross 2005, Ramlo 2015, Harris et al 2021. Participants are asked to rank-order (or "sort") a set of stimuli, within a fixed framework, under a particular condition.…”