Problems of conventional evaluation models can be understood as an impoverished 'conversation' between realities (of non-linearity, indeterminate attributes, and everchanging context), and models of evaluating such realities. Meanwhile, ideas of systems thinking and complexity science -grouped here under the acronym STCSstruggle to gain currency in the big 'E' world of institutionalised evaluation. Four evaluation practitioners familiar with evaluation tools associated with STCS offer perspectives on issues regarding mainstream uptake of STCS in the big 'E' world. The perspectives collectively suggest three features of practicing systemic evaluation: (i) developing value in conversing between bounded values (evaluations) and unbounded reality (evaluand), with humility; (ii) developing response-ability with evaluand stakeholders based on reflexivity, with empathy; and (iii) developing adaptive rather than mere contingent use(fulness) of STCS 'tools' as part of evaluation praxis, with inevitable fallibility and an orientation towards bricolage (adaptive use). The features hint towards systemic evaluation as core to a reconfigured notion of developmental evaluation.
The three core systems concepts – interrelationships, perspectives and boundaries – can be used for framing an impact evaluation (see Williams, this IDS Bulletin). But their use also has implications for the type of learning that an impact evaluation is likely to generate. Moreover, they can help to make the value base of evaluations more explicit. This article first outlines a typology for learning and elaborates on the implications for evaluation and the use of systems concepts. Then a similar typology for values is presented, together with their likely correspondence with learning types. These three aspects are usually dealt with separately in evaluation assignments, although they should be viewed together, as they mutually influence each other or can be seen as complementary. To this end a conceptual framework is proposed which permits to explore and reflect on the connections between the three systems concepts with learning and values.
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.