Analytic Approach of Response Pattern of Diagnostic Test Items in Evaluating Students’ Conceptual Understanding of Characteristics of Particle of Matter

Abstract

This research aimed to evaluate the students’ conceptual understanding and to diagnose the students’ preconceptions in elaborating the particle characteristics of matter by development of diagnostic instrument as well as Rasch model response pattern analysis approach. Data were acquired by 25 multiple-choice written test items distributed to 987 students in North Sulawesi, Indonesia. Analysis on diagnostic test items response pattern was conducted in three steps: 1) conversion of raw score to a homogenous interval unit and effectiveness analysis of measurement instruments; 2) measurement of disparity of students’ conceptual understanding; and 3) diagnosis of students’ preconception by estimation of item response pattern. The result generated information on the diagnostic and summative measurement on students’ conceptual understanding in elaborating the topic; information also acts as empirical evidence on the measurement’s reliability and validity. Moreover, the result discovered a significant disparity between students’ conceptual understanding based on their educational level. It was found that the distractor item response pattern tended to be consistent, indicating a certain tendency of resistant preconception pattern. The findings are expected to be a recommendation for future researchers and educational practitioners that integrate diagnostic and summative measurement with Rasch model in evaluating conceptual understanding and diagnosing misconception. Keywords: conceptual understanding, item response, particle of matter, Rasch model

Validity Analysis Using the Rasch Model in the Development of Alkane Concept Test Instruments

“…Good questions will be considered the same, both for men and women, from the aspect of the level of difficulty of the questions. In this study, the results of the DIF analysis showed that, in general there were no different levels of difficulty based on gender differences (male and female), as seen from the probability value greater than 0.05 (Figure 5) (Chan et al 2020;Laliyo et al 2020). A probability value greater than 0.05 indicates that there is no bias on the items based on gender differences or DIF.…”

Assessing Upper-Secondary School Students’ Interdisciplinary Understanding of Environmental Issues

“…ISSN 1648-3898 /Print/ ISSN 2538-7138 /Online/ Item 2 was with somewhat higher OUTFIT mean square, suggesting less accurate predictions of these items. Even though not all items meet all the criteria, the quality of the items is not affected (Laliyo et al, 2020). The item fit statistics showed that most items were not deviant, valid, and appropriate.…”

Constructivist Approach to Learning Activity: The Case of Junior Secondary Students’ Misconception on the Three States of Matter in Basic Science, Nigeria

“…This finding is further backed by Adadan and Ataman [55] who argued that particulate nature of matter (PNM) is one of the foundational concepts that promote, shape, and constrain the understanding of subsequent concepts in science, particularly in chemistry. However, the fact that conceptual understanding of the topic has been described to be difficult considering the abstract nature of the concept [13]. In addition, the continued low students' achievements, because of ineffective instructional approach adapted by the science teachers [20,56], necessitate the quest for further investigation into basic science instruction.…”

“…The author further suggested that more studies on methods to reduce or eliminate such misconceptions should be conducted. Laliyo et al [13] also argued that more studies should be conducted because some studies have found students' misconception of the states of matter to persist as they progress further. Hanson [14] argued that because of the lingering misconceptions that students hold coupled with low academic achievement, invariably, lead to loss of interest in studying science; thus, teachers should select and adopt instructional approach that investigate prior information of students, provides hands and mind on activities that support science teachers in dissemination of knowledge through inquiry activities.…”