2010
DOI: 10.1007/s11292-010-9117-1
|View full text |Cite
|
Sign up to set email alerts
|

Research design influence on study outcomes in crime and justice: a partial replication with public area surveillance

Abstract: Does the quality of research design have an influence on study outcomes in crime and justice? This was the subject of an important study by Weisburd et al. (2001). They found a moderate and significant inverse relationship between research design and study outcomes: weaker designs, as indicated by internal validity, produced stronger effect sizes. Using a database of evaluations (n=136) from systematic reviews that investigated the effects of public area surveillance on crime, this paper carried out a partial … Show more

Help me understand this report

Search citation statements

Order By: Relevance

Paper Sections

Select...
1
1
1
1

Citation Types

11
32
1

Year Published

2012
2012
2023
2023

Publication Types

Select...
10

Relationship

9
1

Authors

Journals

citations
Cited by 70 publications
(48 citation statements)
references
References 24 publications
11
32
1
Order By: Relevance
“…The difference in results between the present study (20% overall reduction in reconvictions) and the previous evaluation of Citizenship (31% reduction in reconvictions) was anticipated since it supports conclusions from reviews suggesting that stronger research designs are less likely to obtain statistically significant positive outcomes (Weisburd et al, 2001;Welsh et al, 2011). Although the methodological differences were likely to produce different results (i.e., a RCT in Teesside and a quasi-experimental study in County Durham), there were, however, other more practical differences between the studies that have had an impact.…”
Section: Discussionsupporting
confidence: 79%
“…The difference in results between the present study (20% overall reduction in reconvictions) and the previous evaluation of Citizenship (31% reduction in reconvictions) was anticipated since it supports conclusions from reviews suggesting that stronger research designs are less likely to obtain statistically significant positive outcomes (Weisburd et al, 2001;Welsh et al, 2011). Although the methodological differences were likely to produce different results (i.e., a RCT in Teesside and a quasi-experimental study in County Durham), there were, however, other more practical differences between the studies that have had an impact.…”
Section: Discussionsupporting
confidence: 79%
“…This calculation is above Cohen's standard for a medium effect of 0.50 and below that of a large effect at 0.80 (18). Although there is evidence that quasi-experimental studies in crime and justice may exaggerate program outcomes (66,70), the overall effect size is still relatively large compared with assessments of interventions in crime and justice work more generally. In their Campbell review, Braga & Weisburd (14) noted that the only focused deterrence intervention to investigate the existence of spillover effects on gang violence was the Los Angeles evaluation carried out by Tita et al (60).…”
Section: Scientific Evidence On Gun Violence Reduction Impactsmentioning
confidence: 76%
“…Wilkinson & Task Force on Statistical Inference, 1999), recent reviews in crime and justice suggest that weaker research designs often lead to more positive outcomes (e.g. see Weisburd, Lum, & Perosino, 2001;Welsh, Peel, Farrington, Elffers, & Braga, 2011). This does not mean that nonexperimental studies cannot be of high quality, but only that there is evidence that nonex-7.…”
Section: Program Type and Research Design As Effect Size Moderatorsmentioning
confidence: 99%