Uniform presentation of process evaluation results facilitates the evaluation of complex interventions: development of a graph

Bakker, Franka C.; Persoon, Anke; Schoon, Yvonne; Rikkert, Marcel G M Olde

doi:10.1111/jep.12252

Cited by 16 publications

(17 citation statements)

References 26 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…12 While outcome evaluation is important as it can determine whether an intervention (SDD) succeeded or not, process evaluation can help understand what really contributed to outcomes and appropriately interpret findings as well as can facilitate to identify aspects of intervention that could be refined to optimize its effect. 13…”

Section: Designmentioning

confidence: 99%

Implementing Same Day Discharge Following Percutaneous Coronary Intervention

Chen

Lin

Marshall

2019

Journal of Nursing Care Quality

View full text Add to dashboard Cite

show abstract

Section: Designmentioning

confidence: 99%

Implementing Same Day Discharge Following Percutaneous Coronary Intervention

Chen

Lin

Marshall

2019

Journal of Nursing Care Quality

View full text Add to dashboard Cite

show abstract

“…It is argued that both effect and process evaluations are needed when evaluating complex organizationallevel interventions [19][20][21] in order to gain a better understanding of the mechanisms of change. In the present study we will follow these recommendations.…”

Section: Introductionmentioning

confidence: 99%

Study protocol of a co-created primary organizational-level intervention with the aim to improve organizational and social working conditions and decrease stress within the construction industry – a controlled trial

et al. 2020

View full text Add to dashboard Cite

Background: Within construction industry, physical work exposures have long been recognized as possible determinants for musculoskeletal disorders, but less attention has been given the increasing organizational and social work hazards and stress within this industry. There is to date a lack of knowledge about how to improve organizational and social working conditions and decrease stress within the construction industry. Methods: This paper outlines the design of a controlled trial to evaluate the effectiveness of a co-created organizational-level intervention with the aim to improve role clarity, quantitative demands, staffing, planning, team effectiveness, psychosocial safety climate and stress. Two regions (> 700 employees) within one large construction company in Sweden will participate as intervention and control group. Further we present the design of the process evaluation assessing fidelity, support from managers, readiness for change and contextual factors. We will utilize questionnaires, semi-structured interviews, observations and documentation as means for data collection, hence a mixed methods approach is applied. Discussion: The study is expected to contribute to the understanding of how adverse organizational and social working conditions and stress can be improved within the construction industry. By applying co-creation we wish to develop an intervention and implementation strategies that fit to the context, are in line with the needs of endusers and are supported by all management levels-all of which are highlighted features in successful workplace interventions.

show abstract

“…The first step to improving study procedures and program delivery is to evaluate the procedures of ongoing studies and programs, by conducting a process evaluation [13]. Process evaluations can be conducted alongside the delivery of intervention programs, and are aimed at assessing several process outcomes, such as the extent to which the target population was reached and the intervention was delivered according to protocol [14, 15].…”

Section: Introductionmentioning

confidence: 99%

“…Process evaluations can be conducted alongside the delivery of intervention programs, and are aimed at assessing several process outcomes, such as the extent to which the target population was reached and the intervention was delivered according to protocol [14, 15]. Process evaluations allow researchers to better understand the individual intervention components, including their relation to each other, potential barriers to their implementation, and their impact on the intervention aims [13, 16, 17]. Further, process evaluations enable researchers to evaluate the likelihood of theory or implementation failure by linking the outcomes of the process evaluation to the effects of the program [15].…”

Section: Introductionmentioning

confidence: 99%

“…Three organizations were contracted to deliver the program to the participants, and the program was implemented in cooperation with the Dutch Social Security Agency (SSA), as it is the agency with the primary legislative responsibility to support workers who lose their employment contract [20]. Given the multi-component character of the program, and the number of professionals involved [13], it was considered especially desirable to conduct a process evaluation alongside the tailored RTW program. Consequently, alongside the delivery of this program, data regarding process outcomes were collected.…”

Section: Introductionmentioning

confidence: 99%

See 1 more Smart Citation

Offering a tailored return to work program to cancer survivors with job loss: a process evaluation

et al. 2016

View full text Add to dashboard Cite

BackgroundIn Europe, 1.7 million persons of working age are diagnosed with cancer each year. During or after treatment, cancer survivors (CSs) are vulnerable for job loss, and many CSs struggle with return to work (RTW). When offering RTW interventions to CSs, it is important to conduct a process evaluation to assess such factors as the population reached and implementation problems. Recently, we developed an innovative RTW program, tailored specifically to the needs of CSs with job loss in the Netherlands. The aim of this study was to evaluate the likelihood of theory and implementation failure, as well as to evaluate procedures for recruitment, execution and implementation of the tailored RTW program for CSs with job loss.MethodsSix components were evaluated in the RTW program: Recruitment, Reach, Dosage, Implementation, Satisfaction, and Experienced Barriers. Data were provided by logbooks and questionnaires from participating CSs, occupational health care (OHC) professionals, and re-integration coaches and job hunting officers who delivered the RTW program. SPSS and Excel were used to conduct the analyses.Results85 CSs received the tailored RTW program. Their mean age was 47.9 years (SD 8.5). The majority were female (72 %), married (52 %), and of Dutch nationality (91 %). The program reached 88.2 % of the target population and 52 % of participants who started the program received the adequate dosage. The program implementation score was 45.9 %. Participants’ mean overall program duration remained within the protocol boundaries. Re-integration coaches were more satisfied with the program than job hunting officers or OHC professionals. Likewise, participants were more satisfied with the program delivery by the re-integration coaches than with the delivery by the job hunting officers. Reported barriers within the RTW program were a lack of communication, high program intensity and short program duration, and, with regard to the job hunting officers, a lack of experience with cancer-related RTW problems.ConclusionsParticipants, OHC professionals, re-integration coaches and job hunting officers generally had positive experiences with the innovative tailored RTW program. Facilitating communication between the delivering parties, and engaging usual care during program delivery, could be key elements to improved program implementation.Trial registrationDutch Trial Register, registration number NTR3562, registered 07-08-2012.

show abstract

Uniform presentation of process evaluation results facilitates the evaluation of complex interventions: development of a graph

Abstract: A graphical approach - which includes the core results of process evaluation and can be used directly in reporting effectiveness studies - will help researchers and policy makers to interpret and compare effects of complex multi-component interventions.

Cited by 16 publications

References 26 publications

Implementing Same Day Discharge Following Percutaneous Coronary Intervention

Implementing Same Day Discharge Following Percutaneous Coronary Intervention

Study protocol of a co-created primary organizational-level intervention with the aim to improve organizational and social working conditions and decrease stress within the construction industry – a controlled trial

Offering a tailored return to work program to cancer survivors with job loss: a process evaluation

Contact Info

Product

Resources

About