Assessing the reliability and validity of the Risk-Need-Responsivity (RNR) program tool

Abstract

Background Fidelity assessment tools can assess whether a program embraces a core set of principles and performs well. A quality fidelity tool with valid scales can be a feedback loop to identify areas that need further work to improve the program. Using data collected from 1816 correctional and reentry programs in the United States in the construction sample and 761 programs in the confirmation sample, this study examined the internal consistency of the Risk-Need-Responsivity (RNR) Program Tool, an online resource to capture information about structural features of a program. Results The study reports on reliability statistics and factor analyses to highlight individual subscales. Six scales emerged and had acceptable to excellent levels of internal consistency. These scales are staffing, reward-and-sanction, clinical standards for programs, coaching, program duration, and risk-need assessment. Conclusions This article discusses fidelity scales from the RNR Program Tool and provides guidance on the importance of tool development processes to ensure accurate, valid, and reliable scales. The purpose of the RNR Program Tool is to create a modern, online tool integrating both the empirical (research) literature on effective practices and clinical standards on quality programming. This process minimizes the need for consultants by giving program administrators the ability to gather information on their programs, score them, and receive instant and targeted feedback with recommendations for improvement to assess their programs against empirical standards in the field. Furthermore, it provides a standardized tool that administrators can use to examine what type of individuals fare better in their programs. The provided targeted feedback can give the programs the ability to seek technical assistance or guidance in specific areas that can strategically strengthen their program.

What Matters More in Explaining Drug Court Graduation and Rearrest: Program Features, Individual Characteristics, or Some Combination

“…Each drug court is assessed on how well they adhere to EBPs using nine domains measured by the RNR Simulation Tool’s RNR Program Tool (Caudy et al, 2013; Ramezani et al, under review). This program tool allows each program to report on the characteristics of their program (i.e., type of drug treatment programs, type of job training program, etc.…”

“…An example of this would be reducing the frequency of drug testing if the individual has been free from drugs for 90 days. More information on the scales within the RNR tool may be found in Ramezani et al (under review) and Caudy et al (2013).…”

Risk Management Practices and Performance of Mining Projects in Kwale County, Kenya

“…The pilot study involved a pilot trial sample size of 32 project management staff in charge of the mining projects of the 7 mining companies in Kwale County, Kenya. Generally, at least 30 representative participants from the target population provides a reasonable minimum recommendation for a pilot study (Ramezani, Bhati, Murphy, Routh, & Taxman, 2022;Saunders & Kulchitsky, 2021;Snell et al, 2021).…”