Computer-based testing of the modified essay question: the Singapore experience

Abstract

Background: The modified essay question (MEQ), featuring an evolving case scenario, tests a candidate's problem-solving and reasoning ability, rather than mere factual recall. Although it is traditionally conducted as a pen-and-paper examination, our university has run the MEQ using computer-based testing (CBT) since 2003. Aims: We describe our experience with running the MEQ examination using the IVLE, or integrated virtual learning environment (https://ivle.nus.edu.sg), provide a blueprint for universities intending to conduct computer-based testing of the MEQ, and detail how our MEQ examination has evolved since its inception. Methods: An MEQ committee, comprising specialists in key disciplines from the departments of Medicine and Paediatrics, was formed. We utilized the IVLE, developed for our university in 1998, as the online platform on which we ran the MEQ. We calculated the number of man-hours (academic and support staff) required to run the MEQ examination, using either a computerbased or pen-and-paper format. Results: With the support of our university's information technology (IT) specialists, we have successfully run the MEQ examination online, twice a year, since 2003. Initially, we conducted the examination with short-answer questions only, but have since expanded the MEQ examination to include multiple-choice and extended matching questions. A total of 1268 man-hours was spent in preparing for, and running, the MEQ examination using CBT, compared to 236.5 man-hours to run it using a pen-andpaper format. Despite being more labour-intensive, our students and staff prefer CBT to the pen-and-paper format. Conclusions: The MEQ can be conducted using a computer-based testing scenario, which offers several advantages over a pen-and-paper format. We hope to increase the number of questions and incorporate audio and video files, featuring clinical vignettes, to the MEQ examination in the near future.

Medical Education, Pre- and Post-Pandemic Era: A Review Article

“…Additionally, very few have incorporated the assessment component in these formats. Nevertheless, all these online formats require high-standard technology infrastructure, which costs an insane amount of money compared with regular traditional teaching [ 22 , 23 ].…”

An online guided e‐journal exercise in pre‐clerkship years: Oxidative phosphorylation in brown adipose tissue

“…A common problem with short answer questions is that students may often give long answers, in spite of instructions to keep their responses concise . With this in mind, the online question was followed by a boxed space to guide students in terms of the length of the answer desired.…”

Emergency medicine residency training during COVID-19

“…[ 19 ] However, these technology-based solutions can be resource- and manpower-intensive, deterring their use. [ 20 ] Materials often need to be created or modified to suit the alternative media for teaching. Appropriate hosting or storage platforms may also be needed to provide a virtual space for learning, incurring payment or subscription fees.…”