Medical assessment in the age of digitalisation

Abstract

Background: Digital assessment is becoming more and more popular within medical education. To analyse the dimensions of this digital trend, we investigated how exam questions (items) are created and designed for use in digital medical assessments in Germany. Thus, we want to explore whether different types of media are used for item creation and if a digital trend in medical assessment can be observed. Methods: In a cross-sectional descriptive study, we examined data of 30 German medical faculties stored within a common assessment platform. More precise, 23,008 exams which contained 847,137 items were analysed concerning the exam type (paper-, computer-or tablet-based) and their respective media content (picture, video and/or audio). Out of these, 5252 electronic exams with 12,214 questions were evaluated. The media types per individual question were quantified. Results: The amount of computer-and tablet-based exams were rapidly increasing from 2012 until 2018. Computer-and tablet-based written exams showed with 45 and 66% a higher percentage of exams containing media in comparison to paper-based exams (33%). Analysis on the level of individual questions showed that 90.8% of questions had one single picture. The remaining questions contained either more than one picture (2.9%), video (2.7%), audio (0.2%) or 3.3% of questions had picture as well as video added. The main question types used for items with one picture are TypeA (54%) and Long_Menu (31%). In contrast, questions with video content contain only 11% TypeA questions, whereas Long_ Menu is represented by 66%. Nearly all questions containing both picture and video are Long_Menu questions. Conclusions: It can be stated that digital assessment formats are indeed on the raise. Moreover, our data indicates that electronic assessments formats have easier options to embed media items and thus show a higher frequency of media addition. We even identified the usage of different media types in the same question and this innovative item design could be a useful feature for the creation of medical assessments. Moreover, the choice of media type seems to depend on the respective question type.

Virtual exams: has COVID-19 provided the impetus to change assessment methods in medicine?

“…31 , 34 Additionally, it has been reported that 90.8% of questions in online medical assessments have an associated image. 35 If this is representative, administrative costs may increase in relation to data protection, copyright, and server storage. 25 It is therefore essential for costings to be performed during procurement.…”

The Impact of Educational Resources and Perceived Preparedness on Medical Education Performance

“…Educational preparation resources available for undergraduate medical students have seen a substantial growth over the past decade [2,4,8]. In particular, advancements in technologies have paved the way for increased use of digital resources in medical education [1,2,9]. As a result, increased pressure is placed on educators and students alike to identify which resources are most effective for their respective curriculums and individual study habits.…”

Pathology Resident Evaluation During the Pandemic: Testing and Implementation of a Comprehensive Online Pathology Exam

“…Computer exams also facilitate the integration of various types of media into exams, particularly high-quality images, which is critical in pathology exams. 13,14 Our practice and formal exams demonstrated that computerbased exams increase the flexibility of exam administration. For example, several residents were able to complete the exam from home.…”