Background
Evaluation capacity building (ECB) is pivotal in advancing health service quality and maximizing impact through evidence-informed practice. This manuscript documents an overview and protocol for the evaluation of the Program Evaluation Skills Learning by Doing (LbD) ECB initiative, implemented within the Western Sydney Local Health District’s Integrated and Community Health (ICH) directorate. The initiative is designed to enhance staff competencies and strengthen organisational infrastructure for effective service evaluation. By employing an integrated ECB model, the initiative seeks to foster a robust environment supportive of evidence-based practices across diverse health services.
Methods
This study employs a comprehensive mixed methods approach that combines both qualitative and quantitative data to evaluate the LbD initiative. This mixed methodology involves assessing the implementation and outcomes of the three main phases of the initiative: stakeholder engagement; participant selection and project identification; and skills training via an LbD approach. The study aims to elucidate the multifaceted nature of ECB efforts and their application in a community health setting. Quantitative data will be collected through pre- and postintervention surveys to measure changes in skills, attitudes, and organizational support. Qualitative data will be gathered via focus groups and interviews with participants to capture in-depth insights into their experiences and the perceived impact of the initiative.
Discussion
This study provides essential insights into effectively leveraging practitioner training, organizational culture, and systemic support for building the capacity for evidence-informed health service delivery at the community level. By actively involving frontline staff, managers, and leaders in its codesign process, the LbD initiative ensures that evaluation methods are relevant and reflective of real-world settings, thereby enhancing the program's applicability and ownership among participants. The findings are expected to contribute significantly to the fields of research, practice, and policy by offering a replicable model for similar capacity-building initiatives. Additionally, the study addresses the limitations of self-reported data, acknowledges potential biases and emphasizes the importance of triangulating data sources to increase the validity of the findings.