Using time‐lagged panel data analysis to study mechanisms of change in psychotherapy research: Methodological recommendations

Abstract

The introduction of novel methodologies in the past decade has advanced research on mechanisms of change in observational studies. Time‐lagged panel models allow us to track session‐by‐session changes and focus on within‐patient associations between predictors and outcomes. This shift is crucial as change in mechanisms inherently takes place at a within‐patient level. These models also enable preliminary casual inferences, which can guide the development of effective personalised interventions that target mechanisms of change, used at specific treatment phases for optimal effect. Given their complexity, panel models need to be implemented with caution, as different modelling choices can significantly affect results and reduce replicability. We outline three central methodological recommendations for use of time‐lagged panel analysis to study mechanisms of change: (a) taking patient‐specific effects into account, separating out stable between‐person differences from within‐person fluctuations over time; (b) properly controlling for autoregressive effects; and (c) considering long‐term time trends. We demonstrate these recommendations in an applied example examining the session‐by‐session alliance–outcome association in a naturalistic psychotherapy study. We present limitations of time‐lagged panel analysis and future directions.

Well-Being Reduces COVID-19 Anxiety: A Three-Wave Longitudinal Study in China

“…Third, to explore the relationships between SWB and COVID-19 anxiety, three-wave cross-lagged panel models (CLPMs) were tested using structural equation modeling (SEM) in the lavaan package in R (Rosseel, 2012 ). Compared with cross-sectional data collected at a specific point in time that could only help to conjecture causality relying on theoretical inference, panel data with repeated measures of variables at multiple points in time could help to describe the directional influences that one variable has on another across different time points (Falkenström et al, 2020 ; Shingles, 2007 ).…”

The role of the working alliance in psychological treatment of substance use disorder outpatients

“…Finally, WAI t , which represents the alliance in session t, is regressed on CORE-OM t , which represents the effect of symptoms in the week before the session, thus adjusting for the hypothesized reverse causal effect of symptoms on alliance. The within-patient part of the DSEM model is thus a kind of cross-lagged panel model, which is the most appropriate way of analyzing panel data with lagged effects (Falkenström et al, 2020).…”

Do therapist effects really impact estimates of within-patient mechanisms of change? A Monte Carlo simulation study

“…Our focus on mechanisms of change should not be confused with mediation analysis, which is a method commonly used for studying mechanisms of change by estimating indirect effects of treatment on outcome via a candidate mechanism. Our focus is instead on withinpatient fluctuations in a candidate mechanism predicting within-patient changes in outcome, which we would argue is a method well-suited for studying mechanisms of change (Falkenström et al, 2020).…”