Quality and Feature of Multiple-Choice Questions in Education

Abstract

The quality of multiple-choice questions (MCQs) as well as the student's solve behavior in MCQs are educational concerns. MCQs cover wide educational content and can be immediately and accurately scored. However, many studies have found some flawed items in this exam type, thereby possibly resulting in misleading insights into students’ performance and affecting important decisions. This research sought to determine the characteristics of MCQs and factors that may affect the quality of MCQs by using item response theory (IRT) to evaluate data. For this, four samples of different sizes from US and China in secondary and higher education were chosen. Item difficulty and discrimination were determined using item response theory statistical item analysis models. Results were as follows. First, only a few guessing behaviors are included in MCQ exams because all data fit the two-parameter logistic model better than the three-parameter logistic model. Second, the quality of MCQs depended more on the degree of training of examiners and less on middle or higher education levels. Lastly, MCQs must be evaluated to ensure that high-quality items can be used as bases of inference in middle and higher education. Keywords: higher education, item evaluation, item response theory, multiple-choice test, secondary education

Explaining medical students’ perceptions of virtual assessment in the pandemic COVID-19: A content analysis study

“…An effective way to improve the quality of multiple-choice questions is to train teachers in the design of such questions. 21 Limited number of students expressed the view that the implementation of webcam surveillance in their homes would facilitate the regulation of exam conditions, thereby reducing the likelihood of academic dishonesty, such as cheating and the use of unauthorized materials. Conversely, the majority of participants maintained that the sheer volume and complexity of the exam questions, coupled with the limited time allotted for completion, precluded the possibility of cheating.…”

Agile teaching methodology - Manual 

“…Effective questions can be used to reinforce learning and include a combination of low and high level questions for deeper learning, and can also be used to keep learners working and check their understanding (Jia et al, 2020;Redfield and Rousseau, 1981), such as:…”

The quality of test on National Examination of Natural science in the level of elementary school

“…The IPL model is a simple model where the ability of students is determined from the level of difficulty of the test items because the discriminating power has a constant value and the guessing parameter is set to zero. The mathematical formula used in the 1PL model is as in (3).…”

“…The purpose of the assessment is to allow students to show what they have learned, find out how learning improves over time, motivate students, and classify students in class rankings [2]. Assessment is the process of identifying information and interpretations about student learning to provide information about student achievement and progress and set the direction for continuous teaching and learning [3]. Assessments must be carried out by teachers to monitor the process, progress, and improvement of student learning outcomes on an ongoing basis [4].…”