Designing diagnostics in complexity: Measuring technical and contextual aspects in monitoring and evaluation systems

Abstract

Objectives:The article looks at what divergent purposes of M&E mean for how M&E systems are assessed, and how context-appropriate diagnostic studies can be designed. Method:The article draws on two different approaches: a survey that looks at the technical components of an M&E system and a complexity framework that analyses the way a system functions in a broader political and organisational context. The foundation is provided by survey and interview data from over 70 officials from across the City of Johannesburg's administration. Results:The study revealed great diversity as to respondents' understanding of what M&E structures and processes should do and achieve within the city, ranging from a management function closely linked to auditing and oversight responsibilities to a governance role that is more linked to learning and planning. Limitations in M&E capacity and/or performance were linked to contested political and bureaucratic structures. Conclusion:The mixed method approach to diagnostics proposed in this article contributes to the call in the 'Made in Africa' debate for more contextualised methods and tools around the practice and the assessment of M&E. The article proposes the development of a synthetic tool that covers both M&E technical components and capacity on one hand, and an analysis of how these are embedded in a political and organisational context on the other.

Monitoring Systems in a Context of Complexity and Uncertainty

“…The literature on M&E systems in African public sectors broadly agrees that governments place overwhelming emphasis on monitoring practice (rather than evaluation) for public sector management in the region (Basheka and Byamugisha 2015;Mapitsa and Korth 2017). While the reasons and drivers for this (over)investment and the ends to which it contributes are contested, the phenomenon itself is relatively undisputed.…”