Evaluations of training programs to improve human resource capacity for HIV, malaria, and TB control: a systematic scoping review of methods applied and outcomes assessed

Abstract

BackgroundOwing to the global health workforce crisis, more funding has been invested in strengthening human resources for health, particularly for HIV, tuberculosis, and malaria control; however, little is known about how these investments in training are evaluated. This paper examines how frequently HIV, malaria, and TB healthcare provider training programs have been scientifically evaluated, synthesizes information on the methods and outcome indicators used, and identifies evidence gaps for future evaluations to address.MethodsWe conducted a systematic scoping review of publications evaluating postgraduate training programs, including in-service training programs, for HIV, tuberculosis, and malaria healthcare providers between 2000 and 2016. Using broad inclusion criteria, we searched three electronic databases and additional gray literature sources. After independent screening by two authors, data about the year, location, methodology, and outcomes assessed was extracted from eligible training program evaluation studies. Training outcomes evaluated were categorized into four levels (reaction, learning, behavior, and results) based on the Kirkpatrick model.FindingsOf 1473 unique publications identified, 87 were eligible for inclusion in the analysis. The number of published articles increased after 2006, with most (n = 57, 66%) conducted in African countries. The majority of training evaluations (n = 44, 51%) were based on HIV with fewer studies focused on malaria (n = 28, 32%) and TB (n = 23, 26%) related training. We found that quantitative survey of trainees was the most commonly used evaluation method (n = 29, 33%) and the most commonly assessed outcomes were knowledge acquisition (learning) of trainees (n = 44, 51%) and organizational impacts of the training programs (38, 44%). Behavior change and trainees’ reaction to the training were evaluated less frequently and using less robust methods; costs of training were also rarely assessed.ConclusionsOur study found that a limited number of robust evaluations had been conducted since 2000, even though the number of training programs has increased over this period to address the human resource shortage for HIV, malaria, and TB control. Specifically, we identified a lack evaluation studies on TB- and malaria-related healthcare provider training and very few studies assessing behavior change of trainees or costs of training. Developing frameworks and standardized evaluation methods may facilitate strengthening of the evidence base to inform policies on and investments in training programs.

Is knowledge retained by healthcare providers after training? A pragmatic evaluation of drug-resistant tuberculosis management in China

“…This 1-year time frame was chosen for two reasons. First, in a systematic review of training evaluation studies, we found most of the training evaluation used pretraining and post-training tests to assess short-term effectiveness of training programmes, but there is very limited evidence on the long-term impact (more than 6 months) of training participants 24. Therefore, 1 year seemed to be a suitable time period for evaluating the long-term effectiveness of a training programme.…”

Strengthening health systems in Africa: a case study of the Kenya field epidemiology training program for local frontline health workers

“…Although most participants have > 5 years of tenure, they do not have a lot of training in field epidemiology and data management. As reported by other studies, most of the public health trainings that the frontline workers participated in were vertical and program-specific trainings for HIV, TB, and malaria [ 22 ]. FETP-frontline is horizontal training that focuses on competencies outlined by the World Health Organization and its essential public health functions [ 23 ].…”

Quality of Malaria Case Management and Reporting at Public Health Facilities in Six Health Districts in Guinea, 2018

“…However, an assessment of the quality of existing training and its effect on workforce behavior change is also important; a meta-analysis of evaluations of HIV, tuberculosis, and malaria training programs revealed that such programs are rarely robustly evaluated. 22 A systematic review recently highlighted the effectiveness of combining HCW training and supervision for improving HCW performance, although the effect size was still moderate. 23 One notable finding of this survey was how strongly linked correct malaria case management was to perceived HCW norms around case management.…”