The Role of a Computerised Case-based Testing Procedure in Practice Performance Assessment

Abstract

Although CCT was not predictive of SP scores, it was related to working experience. There are good reasons to assume that although SP-scores were more authentic, they were less valid than CCT scores, mainly because they focussed more on thoroughness than on efficiency in data gathering. The results underpin the assumption that for valid performance assessment the most important issue is what information about the candidate is collected and now how authentic the method is.

Assessing Diagnostic Reasoning: A Consensus Statement Summarizing Theory, Practice, and Future Needs

“…Although OSCEs represent a step toward authenticity relative to written or oral examinations, 84 the validity of this method for diagnostic reasoning assessment remains uncertain. 85,86 Virtual Patients Virtual patients, such as the computer-based case simulations employed in Step 3 of the USMLE, prompt examinees to obtain a history, perform a physical examination, and make diagnostic and therapeutic decisions. 87,88 Examinees direct the patient encounter and the advance of simulated time, independently generating diagnostic possibilities and determining what additional information is necessary to confirm or refute initial hypotheses.…”

The validity and reliability of a Direct Observation of Procedural Skills assessment tool: assessing colonoscopic skills of senior endoscopists

“…Both measures are negatively correlated with the number of procedures carried out during the past year; thus, the more procedures undertaken, the poorer scores on formal tests. This could indicate that the DOPS and MCQ provide a poor assessment of the competencies; however, this phenomenon has been observed in other contexts 24 and has been explained in terms of the short-cuts taken by expert practitioners. The MCQ has been refined and is now in single-best-answer format.…”

Effectiveness of oncogenetics training on general practitioners’ consultation skills: a randomized controlled trial

“…Whether there is a sustainable impact on applicability of the training in practice, including timely identification of patients with a possible cancer predisposition syndrome and appropriate referral, will need further longer-term studies. Designed to fill gaps in physicians' competencies and boost their confidence in using basic clinical genetic principles and activities, 26,27,28,29,30 the oncogenetics training addressed previously prioritized key features of genetic consultation skills and attitude but not basic science knowledge.…”