Practical randomly selected question exam design to address replicated and sequential questions in online examinations

Abstract

Examinations form part of the assessment processes that constitute the basis for benchmarking individual educational progress, and must consequently fulfill credibility, reliability, and transparency standards in order to promote learning outcomes and ensure academic integrity. A randomly selected question examination (RSQE) is considered to be an effective solution to mitigate sharing of questions between students by addressing replicated inter-examination questions that compromise examination integrity and sequential intra- examination questions that compromise examination comprehensivity. In this study, a Monte Carlo approach was used to design six examination schemes for the purpose of generating and evaluating 600 RSQEs in order to investigate the effects of RSQE design on replicated inter-examination and sequential and intra-examination questions. Results revealed that the number of randomly selected questions from the pool and the number of sub-pools inversely affected the replication and sequencing of the examination questions. Thus, by designing the RSQE in many sub-pools, in equivalence to the number of examination questions and selecting only one question from each sub-pool, and updating the sub-pools after each examination, the passing of information can be prevented, ensuring the integrity of the examinations.

ChatGPT and Higher Education: A Pathway to Unprecedented Progress

“…Furthermore, the usage of AI chatbots like ChatGPT for the purpose of generating responses to examination questions raises a valid apprehension over the potential for academic misconduct. Participating in acts of academic dishonesty can lead to substantial consequences, both within the realm of education and in terms of legal implications (Elkhatat, 2023). To maintain academic integrity, it is crucial for students and researchers to comprehend plagiarism and academic dishonesty regulations thoroughly and to demonstrate appropriate utilization of ChatGPT.…”

Evaluating the authenticity of ChatGPT responses: a study on text-matching capabilities

“…Consequently, implementing measures to mitigate plagiarism is crucial for upholding academic integrity and precluding the perpetuation of such dishonest practices in students' subsequent academic and professional pursuits. (Alsallal et al 2013;Elkhatat 2022;Foltýnek et al 2020). Text-Matching Software Products (TMSPs) are potent tools academic institutions employ to identify plagiarism owing to their advanced text-matching algorithms and comprehensive databases encompassing web pages, journal articles, periodicals, and other publications.…”

Advancing students' trouble shooting skills with open‐ended questions and computer‐aided learning using Aspen Plus® in a multistage lab experiment

“…Bloom's taxonomy indicates that laboratory education promotes high-level learning outcomes through applying, analyzing, synthesizing, and evaluating experimental results [4,9,16]. This results in a better understanding of the complexity and ambiguity of practical work by developing practical reasoning skills [2].…”