“The More We Know, the More We're Able to Help”: Participatory Development of an Evaluation Framework for Community Health Worker Programs

Abstract

Context: It is critical to evaluate community health worker (CHW) programs to maximize effectiveness. However, there is little consensus, and structure, for how to evaluate such programs. Objective: The purpose of this study was to develop a flexible framework for evaluating components of CHW programs in community and clinical settings. Design: Semistructured interviews were conducted with CHWs and their supervisors to determine evaluation categories for the framework. A survey was then administered to pilot the framework at federally qualified health centers and community-based organizations with existing CHW programs. Setting: Eighteen federally qualified health centers and community-based organizations in Louisiana, Mississippi, Alabama, and Florida. Participants: Participants consisted of 23 CHWs and 19 CHW supervisors. Results: Interview participants directly informed the development of an evaluation framework for CHW programs. The framework consists of 7 evaluation categories: client relations, intraorganizational relations, interorganizational relations, capacity development, program effectiveness, cost-efficiency, and sustainability. Survey respondents specified best practices for program implementation for each evaluation category. Recommendations for CHW program evaluation include tailoring evaluation efforts and data collection methods to program context, using mixed-methods approaches for collecting evaluation data, and streamlining evaluation efforts with an organization's existing evaluation systems. Conclusions: The evaluation framework is a flexible and practical model for collecting information needed for monitoring and evaluating CHW programs. By relying on practitioners' perspectives, this study contributes to an evidence base for implementing and evaluating CHW programs.

Community health workers' perspectives on integrating into school settings to support student health

“…In terms of evaluating the impact of CHW programming in schools, participants in this study recommended recording CHWs' interactions with the school community, similar to previous research highlighting the importance of tracking the number and quality of interactions between CHWs and clients, team members, and external organizations ( 52 ). While not emphasized in this study, other relevant metrics of success described in the literature include cost-efficiency, sustainability, job satisfaction, and CHW involvement in other areas such as school policy ( 36 , 44 , 53 ).…”

“…While not emphasized in this study, other relevant metrics of success described in the literature include cost-efficiency, sustainability, job satisfaction, and CHW involvement in other areas such as school policy ( 36 , 44 , 53 ). Fewer studies have endorsed specific evaluation methods; however, some recommend mixed-methods approaches, aligning with participants who indicated qualitative data can capture nuances while quantitative data can provide summative assessments of effects as well as inform future programs and grant applications ( 52 , 54 ).…”