Taking “the boss” into the real world: Field interrater reliability of the Short‐Term Assessment of Risk and Treatability: Adolescent Version

Beuf, Tamara L. F. De; Ruiter, Corine de; Edens, John F.; Vogel, Viviënne de

doi:10.1002/bsl.2503

Cited by 5 publications

(5 citation statements)

References 47 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…The ICCs (absolute agreement) for the final risk judgments ranged from .46 for health neglect to .86 for suicide. This reliability sample was part of a larger field interrater reliability evaluation of the START:AV (De Beuf et al, 2021).…”

Section: Resultsmentioning

confidence: 99%

“…As mentioned earlier, a first limitation is the relatively low interrater reliability for the total scores and several final risk judgments. These reliability ratings represent the agreement between clinicians and researchers who rated the same cases, however, with differences in the information that was available for each evaluator group (De Beuf et al, 2021). This may reflect real-world differences between evaluators in the field and, therefore, provide insight in the actual field performance of the risk assessment instrument and the impact on predictive validity.…”

Section: Discussionmentioning

confidence: 99%

See 1 more Smart Citation

Prospective Field Validation of the START:AV in a Dutch Secure Youth Care Sample

et al. 2021

Self Cite

View full text Add to dashboard Cite

The Short-Term Assessment of Risk and Treatability: Adolescent Version (START:AV) is a risk assessment instrument for adolescents that estimates the risk of multiple adverse outcomes. Prior research into its predictive validity is limited to a handful of studies conducted with the START:AV pilot version and often by the instrument’s developers. The present study examines the START:AV’s field validity in a secure youth care sample in the Netherlands. Using a prospective design, we investigated whether the total scores, lifetime history, and the final risk judgments of 106 START:AVs predicted inpatient incidents during a 4-month follow-up. Final risk judgments and lifetime history predicted multiple adverse outcomes, including physical aggression, institutional violations, substance use, self-injury, and victimization. The predictive validity of the total scores was significant only for physical aggression and institutional violations. Hence, the short-term predictive validity of the START:AV for inpatient incidents in a residential youth care setting was partially demonstrated and the START:AV final risk judgments can be used to guide treatment planning and decision-making regarding furlough or discharge in this setting.

show abstract

Section: Resultsmentioning

confidence: 99%

Section: Discussionmentioning

confidence: 99%

Prospective Field Validation of the START:AV in a Dutch Secure Youth Care Sample

et al. 2021

Self Cite

View full text Add to dashboard Cite

show abstract

“…Results are based on existing risk assessment data from actual clients coded by probation officers based on their professional judgment in daily practice and not on controlled research among a specific participant group. This corresponds to the need for more field studies, as expressed by several scholars (e.g., de Beuf et al, 2021; Edens & Boccaccini, 2017). A final strength is that this study controlled for other potential predictors of recidivism, enabling the exploration of to which extent specific financial factors are predictive.…”

Section: Discussionmentioning

confidence: 99%

Financial Problems and Debt as Predictive Factors for Recidivism

Beek¹,

Vogel

Mheen

2023

Criminal Justice and Behavior

Self Cite

View full text Add to dashboard Cite

This study aimed to examine the unique predictive validity of debt regarding recidivism and what elements are specifically predictive. This was done based on a Dutch sample of 250 people on probation using an explorative research tool, the Finances, Debt, and Offending Scale (FDOS). Cox survival regression and receiver operating characteristics analyses were conducted on the total FDOS and its individual items as predictors and diverse recidivism criteria. The average follow-up duration was 5.41 years. The results show that debt moderately predicts recidivism (adjusted for other predictors). The FDOS significantly predicted recidivism on all three levels of severity, and regarding the type of crime, it predicted recidivism in property and drug-related crime. Earlier debt and probation officers’ indications of whether finances are criminogenic were especially predictive. These insights may help frontline service providers better understand the role of finances in recidivism, measure financial problems in risk assessment, and select interventions.

show abstract

“…This research into field reliability will be challenging to investigate unequivocally, also because of the organizational and professional aspects involved in the use of the VERA-2R in practice ( 23 ). Field reliability of risk assessment instruments is often lower than reliability by highly trained raters, but they provide insights into the performance in real-world settings, exposing factors that affect reliability ( 44 , 45 ). Therefore, since repeated measurements with the VERA-2R are used by professionals, the interrater reliability of the VERA-2R in practice could, and should, be established in future research.…”

Section: Discussionmentioning

confidence: 99%

Interrater and intra-rater reliability of the VERA-2R tool

Duits,

Kempes

2023

Front. Psychiatry

View full text Add to dashboard Cite

IntroductionThe Violent Extremism Risk Assessment - Version 2 Revised (VERA-2R) is an evidence-based structured professional judgement (SPJ) tool for ideologically motivated violence. Use of the tool can help professionals in risk assessment and risk management of suspected and convicted terrorists and violent extremists at different stages within the criminal process. It is important that the tool leads to reliable and valid risk assessments.MethodsThe present study aimed to establish the reliability of the VERA-2R, focusing on the interrater- and intrarater reliability. Trained researchers assessed the interrater- and intrarater reliability, respectively in 30 and 33 cases of Dutch convicted terrorist offenders, on the basis of extensive judicial files.ResultsIn general, the average amount of agreement on the indicators and structured risk judgements can be classified as good to excellent, for both the interrater- and intra-rater reliability. However, six indicators were found to have low reliability. Above clarifying the reliability of the VERA-2R, this study also showed how the interrater- and intrarater reliability of a SPJ tool can be investigated with trained assessors based on judicial files. This can be of added value, because existing reliability studies often use case vignettes, have a small sample size and/or do not include a stringent training program.DiscussionWith this research, we can make more substantiated recommendations on how the VERA-2R can be improved. This could lead to more accurate risk assessments and risk management strategies. However, in order to develop a more reliable and valid VERA-2R instrument, the remaining psychometric properties must also be investigated and published. That will be discussed in a future article.

show abstract

Taking “the boss” into the real world: Field interrater reliability of the Short‐Term Assessment of Risk and Treatability: Adolescent Version

Cited by 5 publications

References 47 publications

Prospective Field Validation of the START:AV in a Dutch Secure Youth Care Sample

Prospective Field Validation of the START:AV in a Dutch Secure Youth Care Sample

Financial Problems and Debt as Predictive Factors for Recidivism

Interrater and intra-rater reliability of the VERA-2R tool

Contact Info

Product

Resources

About