A Scoping Review of the Influence of Evidence-Based Program Resources (EBPR) Websites for Behavioral Health

Lee-Easton, Miranda J.; Magura, Stephen; Maranda, Michael; Landsverk, John; Rolls-Royce, Jennifer; Green, Brandn; DeCamp, Whitney; Abu-Obaid, Ruqayyah

doi:10.1007/s10488-022-01245-8

Cited by 5 publications

(1 citation statement)

References 38 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“… 1 - 4 Evidence-based interventions are interventions that have “demonstrated positive outcomes through high quality clinical or organizational research” (p.1). 5 One type of publicly available resource for locating information about evidence-based interventions is the evidence-based program resources website (EBPR). 1 , 2 , 4 These EBPRs are databases of “reports that summarize the available evidence of programs’ effectiveness, including programs in social services, education, public health, and criminal justice” (p. 409).…”

Section: Introductionmentioning

confidence: 99%

Discrepancies in Ratings of Behavioral Healthcare Interventions Among Evidence-Based Program Resources Websites

Lee-Easton

Magura

2023

INQUIRY

Self Cite

View full text Add to dashboard Cite

Decision makers in the behavioral health disciplines could benefit from tools to assist them in identifying and implementing evidence-based interventions. One tool is an evidence-based program resources website (EBPR). Prior studies documented that when multiple EBPRs rate an intervention, they may disagree. Prior research concerning the reason for such conflicts is sparse. The present study examines how EBPRs rate interventions and the sources of disagreement between EBPRs when rating the same intervention. This study hypothesizes that EBPRs may disagree about intervention ratings because they either use different rating paradigms or they use different studies as evidence of intervention effectiveness (or both). This study identified 15 EBPRs for inclusion. One author (M.J.L.E.) coded the EBPRs for which “tiers of evidence” each EBPR used to classify behavioral health interventions and which criteria they used when rating interventions. The author then computed one Jaccard index of similarity for the criteria shared between each pair of EBPRs that co-rated interventions, and one for the studies used by EBPR rating pairs when rating the same program. The authors used a combination of chi-square, correlation, and binary logistic regression analyses to analyze the data. There was a statistically significant negative correlation between the number of Cochrane Risk of Bias criteria shared between 2 EBPRs and the likelihood of those 2 EBPRs agreeing on an intervention rating ( r = −.12, P ≤ .01). There was no relationship between the number of studies evaluated by 2 EBPRs and the likelihood of those EBPRs agreeing on an intervention rating. The major reason for disagreements between EBPRs when rating the same intervention in this study was due to differences in the rating criteria used by the EBPRs. The studies used by the EBPRs to rate programs does not appear to have an impact.

show abstract