Perceptions and performance using computer-based testing: One institution's experience

Bloom, Timothy J.; Rich, Wesley; Olson, Stephanie M.; Adams, Michael L.

doi:10.1016/j.cptl.2017.10.015

Cited by 19 publications

(21 citation statements)

References 11 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…They state that "Eassessment can take a number of forms, including automating administrative procedures; digitising paper-based systems, and online testing" indicating that digitalisation of medical assessments occurs on several levels apart from the exam delivery mode itself. Many studies are available, that report the transition of traditionally pen and paper testing to electronic exam [32,[34][35][36][37]. This change leads to an increase of electronic exam delivery and can be found worldwide and in several areas of study and is in accordance with our findings, that the number of electronic exams is continuously increasing.…”

Section: Discussionsupporting

confidence: 88%

Medical assessment in the age of digitalisation

Egarter¹,

Mutschler

Tekian

et al. 2020

BMC Med Educ

View full text Add to dashboard Cite

Background: Digital assessment is becoming more and more popular within medical education. To analyse the dimensions of this digital trend, we investigated how exam questions (items) are created and designed for use in digital medical assessments in Germany. Thus, we want to explore whether different types of media are used for item creation and if a digital trend in medical assessment can be observed. Methods: In a cross-sectional descriptive study, we examined data of 30 German medical faculties stored within a common assessment platform. More precise, 23,008 exams which contained 847,137 items were analysed concerning the exam type (paper-, computer-or tablet-based) and their respective media content (picture, video and/or audio). Out of these, 5252 electronic exams with 12,214 questions were evaluated. The media types per individual question were quantified. Results: The amount of computer-and tablet-based exams were rapidly increasing from 2012 until 2018. Computer-and tablet-based written exams showed with 45 and 66% a higher percentage of exams containing media in comparison to paper-based exams (33%). Analysis on the level of individual questions showed that 90.8% of questions had one single picture. The remaining questions contained either more than one picture (2.9%), video (2.7%), audio (0.2%) or 3.3% of questions had picture as well as video added. The main question types used for items with one picture are TypeA (54%) and Long_Menu (31%). In contrast, questions with video content contain only 11% TypeA questions, whereas Long_ Menu is represented by 66%. Nearly all questions containing both picture and video are Long_Menu questions. Conclusions: It can be stated that digital assessment formats are indeed on the raise. Moreover, our data indicates that electronic assessments formats have easier options to embed media items and thus show a higher frequency of media addition. We even identified the usage of different media types in the same question and this innovative item design could be a useful feature for the creation of medical assessments. Moreover, the choice of media type seems to depend on the respective question type.

show abstract

Section: Discussionsupporting

confidence: 88%

Medical assessment in the age of digitalisation

Egarter¹,

Mutschler

Tekian

et al. 2020

BMC Med Educ

View full text Add to dashboard Cite

show abstract

“…T. Bloom, T. Rich, S. Olson, M. Adams thoroughly study and evaluate students' and teachers' perceptions of the transition to the computer-based testing format in educational process [9]. H. Sari, H. Yahsi Sari, A. Huggins Manley closely study the characteristics of a relatively new type of testing − Computer Adaptive Multistage Testing − including its working principle, adaptation procedure (routing method), test assembly, and scoring.…”

Section: Introductionmentioning

confidence: 99%

Application of Achievement Testing Software of Cadets in Higher Military Educational Institutions

Lahodynskyi

Buyalo

Khamula

2021

ITLT

View full text Add to dashboard Cite

The article presents description, advantages, and use of the Achievement Testing Software (ATS) developed by the authors – the teaching staff of the Military Diplomatic Academy named after Yevheniy Bereznyak – for cadets’ achievement testing in the educational process of higher military educational institutions. The authors prove the necessity of the ATS introduction into the educational process of such institutions due to the inability of existing computer testing software to fully satisfy their needs (high costs of technical maintenance, closed exit codes, and constant reliance on the Internet connection making it impossible to provide sensitive information security). Unlike other systems, the ATS is a reliable instrument of military educational control, capable of operating off-line. It was developed based on fundamental works in test theory, measurement and evaluation by Ukrainian and foreign scholars. It can be widely used for different types of achievement testing in higher military educational institutions: classroom; entrance or summative; and in any type of military course. The ATS rational use allows saving learning time and teachers’ effort, simultaneous engagement of many cadets in the training process, as well as objective measurement and evaluation through its automation. The ATS also provides capabilities of control over the educational process which allow curricula correction due to the constant feedback from cadets. Basically, the ATS performs two interrelated functions: test development and editing (by teachers); and academic achievement measuring (by cadets through the developed test items). The system can be easily installed on personal computers with Windows XP Professional SP2 operational system. The article describes in greater detail the procedure of operating in two modules: the Teacher’s Module and the Testing Module. Here, the ATS provides a user-friendly menu that can be easily navigated by pressing on buttons and selecting necessary options according to the instructions. The test entrance is password-protected, the test is encrypted, and the test score can be quickly viewed by cadets and teachers immediately after its completion. The ATS efficiency was proved through an experiment involving cadets of the Military Diplomatic Academy named after Yevheniy Bereznyak by demonstrating improvement in their performance.

show abstract

“…Success in learning consists of several factors, one of which is the readiness of the students themselves because readiness is very important in the learning process (Bloom et al, 2018), Likewise, with online learning, online learning readiness is also very important, because it will greatly support success. of learning itself.…”

Section: Introductionmentioning

confidence: 99%

Analysis of cadets' online learning readiness at PIP Makassar

Widarbowo¹

2021

j. ijolec.

View full text Add to dashboard Cite

This study was designed to see the readiness of online learning of cadets at PIP Makassar during the Covid-19 period with a quantitative approach. This research uses a descriptive research method. For data processing, by grouping the data from the questionnaire/questionnaire according to the variables studied, looking for the average value in each group of research variables, determining the level of readiness for each group of variables, determining the level of readiness to apply online learning at the institutional level. The research was conducted at PIP Makassar, which was held at the end of June. The subjects in this study were 362 cadets from 3 majors in Nautika, KALK and Teknika. This study used a questionnaire containing 30 questions based on predetermined reference factors. From the results of the questionnaire, it will be assessed using a 0-2 rating scale. Dari on data obtained showed the lowest scores were entered in the category of 11-25 are six people, which indicates that the cadets must take the time and effort to prepare and adapt to online learning. While the cadets with a score of 51-60 are 92 people who show the level of readiness that is very ready for online learning, while gender does not affect online learning readiness.

show abstract

Perceptions and performance using computer-based testing: One institution's experience

Cited by 19 publications

References 11 publications

Medical assessment in the age of digitalisation

Medical assessment in the age of digitalisation

Application of Achievement Testing Software of Cadets in Higher Military Educational Institutions

Analysis of cadets' online learning readiness at PIP Makassar

Contact Info

Product

Resources

About