Monotonic Responses in Radiology Education Evaluations

Utility of Interobserver Agreement Statistics in Establishing Radiology Resident Learning Curves During Self-directed Radiologic Anatomy Training

“…This pattern indicates that the evaluators have not given the assessment much thought or are uncommitted because the benefits of their evaluation are unclear to them. Whatever the underlying cause may be, the information provided by a monotonic response is likely to be of limited or no value (26). Although data-driven educational evaluation has the potential to advance learning in radiology residency, the authors believe that the weaknesses mentioned previously must be adequately mitigated through employment of evaluation methods which rest on broad statistical foundations.…”

“…Therefore, the use of formal rating scales instead of or in addition to verbal reports has been recommended (23). Liaison Committee on Medical Education and Accreditation Council on Graduate Medical Education require that programs conduct regular evaluations of their educational activities (26). One weakness of such evaluations stems from the fact that they are based on questionnaires using Likert scale response formats.…”