On Evaluating the Performance of Problem Structuring Methods: An Attempt at Formulating a Conceptual Model

Abstract

In the past decade there has been a discussion on the need for and degree of empirical evidence for the effectiveness of problem structuring methods (PSMs). Some authors propose that PSMs are used in unique situations which are difficult to study, both from a methodological and a practical perspective. In another view experimental validation is necessary and, if not obtained, PSMs remain substantially invalidated and thus 'suspect' with regard to their claims of effectiveness. Both views agree on one point: the necessity of being clear about the important factors in the context in which a method is used, the method's aims and its essential elements through which these aims are achieved. A clear formulation of central variables is the core of a theoretical validation, without which empirical testing of effects is impossible. Since the process of PSMs is sometimes referred to as 'more art than science', increased clarity on the PSM process also supports the transfer of methods. In this article we consider goals important to most PSMs, such as consensus and commitment. We then focus on outcomes of group model building, and expectations on how context and group modeling process contributes to outcomes. Next we discuss the similarity of these central variables and relations to two sets of theories in social psychology: the theory of planned behavior and dual process theories of persuasion. On the basis of these theories we construct a preliminary conceptual model on group model building effectiveness and address its practical applicability for research on PSM.

Evaluating communication to optimise consumer-directed energy efficiency interventions

“…Advocacy generally for the co-use of the ELM and TPB is to be found in several sources (Beale and Bonsall, 2007;Brown et al, 2010;Heinsman et al, 2008;Karahanna et al, 1999;Rouwette et al, 2009). …”

Using a model of the performance measures in Soft Systems Methodology (SSM) to take action: a case study in health care

“…Instead of directly asking patients on changes in insight of action, Rouwette et al (2009) suggest to assess insights before and after the intervention. Therefore, during this study participants'…”

Quality of life in tertiary healthcare services: lessons from the Saudi Arabia accreditation system

“…There is no justifi cation to claim that outcomes are the only framework in measuring indicators in health care services because the outcomes measurement cannot stand alone (Moon, 2000;Rouwette et al, 2009). Therefore, access and effectiveness, other factors that correlate with and impact on patients' preferences (Campbell et al, 2000), are considered.…”