An experimental test of assessment reactivity within a web-based brief alcohol intervention study for college students

Abstract

Objective Web-based brief alcohol intervention (WBI) programs have efficacy in a wide range of college students and have been widely disseminated to universities to address heavy alcohol use. In the majority of efficacy studies, web-based research assessments were conducted before the intervention. Web-based research assessments may elicit reactivity, which could inflate estimates of WBI efficacy. The current study tested whether web-based research assessments conducted in combination with a WBI had additive effects on alcohol use outcomes, compared to a WBI only. Methods Undergraduate students (n= 856) from universities in the United States and Canada participated in this online study. Eligible individuals were randomized to complete 1) research assessments + WBI or 2) WBI-only. Alcohol consumption, alcohol-related problems, and protective behaviors were assessed at one-month follow up. Results Multiple regression using 20 multiply imputed datasets indicated there were no significant differences at follow up in alcohol use, alcohol-related problems, or protective behaviors used when controlling for variables with theoretical and statistical relevance. A repeated measures analysis of covariance revealed a significant decrease in peak estimated blood alcohol concentration in both groups, but no differential effects by randomized group. There were no significant moderating effects from gender, hazardous alcohol use, or motivation to change drinking. Conclusions Web-based research assessments combined with a web-based alcohol intervention did not inflate estimates of intervention efficacy when measured within-subjects. Our findings suggest universities may be observing intervention effects similar to those cited in efficacy studies, although effectiveness trials are needed.

Randomized Study of Assessment Effects on Alcohol Use by Persons With HIV in Rural Uganda

“…We found no evidence of assessment reactivity resulting from study interviews in persons with HIV in Uganda. This is consistent with previous findings of no difference between study and minimally assessed or control groups with the outcome of reduced drinking or risk reduction (Cherpitel et al, 2010;Fazzino et al, 2016;Magill et al, 2012) but differs from other studies that did find evidence of assessment reactivity on alcohol use Kypri et al, 2007;McCambridge & Day, 2008;Worden et al, 2008). We also found no evidence of differences in assessment reactivity by gender, contrary to previous findings (Magill et al, 2012).…”

“…Similar pre-treatment changes in drinking were seen in alcohol-dependent women (Epstein et al, 2005), as well as in adolescent drinkers (Kaminer et al, 2008). In contrast, several randomized studies found no difference in drinking between assessed and minimally assessed study arms, for example, among college students (Fazzino et al, 2016;Magill et al, 2012) or hazardous drinkers in hospital emergency departments (Cherpitel et al, 2010;Daeppen et al, 2007).…”

Evaluating Personalized Feedback Intervention Framing with a Randomized Controlled Trial to Reduce Young Adult Alcohol-Related Sexual Risk Taking

“…All measures and interventions were completed entirely via the Internet. Recent research has shown no significant reactivity effects from online assessments combined with alcohol interventions (Fazzino, Rose, & Helzer, 2016). Participants were carefully monitored at each assessment for consumption of potentially lethal amounts of alcohol (blood alcohol concentration of .35% or greater).…”

The use and Impact of Self-Monitoring on Substance use Outcomes: A Descriptive Systematic Review

“…[16][17][18] SM was initially introduced as a methodological concern in treatment studies, as it appeared that measurement reactivity was affecting treatment outcomes. [14][15][16][17][18][19][20][21] Patients often report that self-monitoring helped them to reduce use and gain important insight into their behavior. 22 Substance use studies have examined assessment as an intervention (e.g., using assessments to promote behavior change) for this reasonhowever, results are mixed across the literature as to whether SM interventions produce consistent outcomes for substance users.…”