Evaluating complex interventions using qualitative longitudinal research: a case study of understanding pathways to violence prevention

Abstract

Qualitative longitudinal research may help understand people’s changing experiences during interventions: dynamics which are often overlooked in evaluations. We present a case study of a partner violence prevention program where we conducted 33 repeat interviews every one to two months with nine participants, and analyzed participant trajectories. We found that participants’ relationship-related beliefs and intentions changed, promoting self-reflection that in turn helped alter their relationship dynamics. Our qualitative longitudinal approach allowed us to detect and track specific examples of change, identify influential elements of the program, and gather contextualized data about participants’ lived experiences. Qualitative longitudinal research provided evidence of gradual shifts on the pathways to violence prevention. Long term effects of violence prevention interventions are very hard to measure directly. We argue that a qualitative longitudinal approach provides a way to measure subtle changes that can serve as proxies for longer term impacts.

Mechanisms for the prevention of adolescent intimate partner violence: a realist review of interventions in low- and middle-income countries

“…Nevertheless, a growing number of interventions, including some in this review, have been able to show quantitatively the relationship between increasing support for gender equitable attitudes and norms and reduced VAW (36,37). Similarly, the qualitative studies in this review provide evidence in support of this pathway (35,45,48), particularly the longitudinal repeat qualitative data from Mexfam's comprehensive sexuality education intervention, which was able to show incremental changes in participants attitudes towards different types of IPV over time and discussions in later interviews of how they had changed harmful behaviours in their relationships as a result (48).…”

“…There was clear support for this mechanism in a longitudinal qualitative analysis of Mexfam's school-based CSE intervention in Mexico City. Participants engaged in self-reflection in light of the content presented during the course, particularly around concepts of jealously and controlling behaviour (48). The reconceptualisation of these concepts as types of violence, rather than expressions of love, led to participants stating new intentions for their relationships, and presenting more positive relationship narratives in later interviews.…”

‘I Enjoy Having Someone to Rant to, I Feel Like Someone is Listening to Me’: Exploring Emotion in the Use of Qualitative, Longitudinal Diary-Based Methods

“…She describes this as intensively walking alongside people to gain a processual understanding of how experiences and perceptions are created, negotiated, lived and experienced. Thus, qualitative longitudinal research is particularly suited towards studies that investigate changes and adaptations to traumatic and historic events (such as the global pandemic), as well as pathways, transitions and trajectories over time (Dwyer & Patrick, 2021; Grossoehme & Lipstein, 2016; Makleff et al, 2021; Patrick et al, 2021; Treanor et al, 2021; Weller, 2012). Nevertheless, there are very few qualitative, diary-based studies with young people, longitudinal or otherwise.…”

Evaluating Complex Interventions Using Qualitative Longitudinal Research: A Case Study of Understanding Pathways to Violence Prevention

“…This theory of change, which drew from practice-based knowledge and academic literature, served as a theoretical framework for the study. Throughout data collection and analysis, we iteratively refined the theory of change and identified four pathways of change through which the intervention might contribute to IPV prevention: (a) communicating about relationships, sexuality, and violence; (b) taking protective and preventive actions to promote equitable and less violent relationships; (c) accessing violence-related and sexual and reproductive health services; and (d) shifting beliefs and behaviors related to gender, sexuality, and violence ( Makleff, 2020 ). The evaluation was designed to explore these hypotheses and understand how and why the program worked in its particular context.…”