Assessing the Validity and Reliability of Science Multiple Choice Test Using Rasch Dichotomous Measurement Model

Dzin, Najah Hazirah Mohd; Lay, Yoon Fah

doi:10.33225/jbse/21.20.927

Cited by 3 publications

(3 citation statements)

References 29 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Regarding the proposed scale of science practices, the results revealed that the person reliability separation index was 2.01 and the person reliability was 0.80. The item separation index and the item reliability were 8.01 and 0.98 respectively, indicating an excellent level of reliability (MohdDzin& Lay, 2021).…”

Section: Discussionmentioning

confidence: 91%

Implementing next generation science practices in classrooms: Findings from TIMSS 2019

Sabah,

Mutasem M. Akour,

Hind Hammouri

2023

tused

View full text Add to dashboard Cite

This study developed and validated the Science Practice Scale (SPS) and investigated the implementation of scientific teaching practices by Grade 8 science teachers in Jordan. The responses of 235 8th grade science teachers who participated in the Trends in International Mathematics and Science Study [TIMSS] of 2019 were analysed using the Rasch measurement. We found significant evidence supporting the construct validity of the SPS scale. The results showed that the estimated difficulty level of implementing the practices varies from -1.26 logit (observing natural phenomena) to 2.27 logit (conducting fieldwork), indicating that the level of conducting field experiments was very low. The results of the t-test (t = 0.267, df = 222, p<0.05) indicated that no statistically significant differences existed between male and female science teachers in implementing scientific practices. The Ministry of Education of Jordan is encouraged to organise specific professional development programmes to promote science teachers’ implementation of these practices, especially with regards to organising fieldwork and giving their pupils opportunities to design and conduct experiments and present data. The current study provides recommendations for improving the TIMSS teacher questionnaire and introduces suggestions for further research.

show abstract

Section: Discussionmentioning

confidence: 91%

Implementing next generation science practices in classrooms: Findings from TIMSS 2019

Sabah,

Mutasem M. Akour,

Hind Hammouri

2023

tused

View full text Add to dashboard Cite

show abstract

“…A Rasch measurement model (Bond & Fox, 2015;Liu, 2010;Mohd Dzin & Lay, 2021) to analyze the collected data using Winsteps software (Linacre, 2006) and SPSS. The reliability indices, difficulty estimates of test questions, infit and outfit statistics, and PTMEA correlations were estimated using Winsteps software.…”

Section: Data Analysis and Resultsmentioning

confidence: 99%

Science and engineering students’ difficulties in understanding vector concepts

Sabah

2023

EURASIA J Math Sci Tech Ed

View full text Add to dashboard Cite

The study assesses science and engineering students’ difficulties in understanding vector concepts. Test of understanding of vectors was administered to 101 university students who were completing their second introductory physics course. Rasch measurement software (Winsteps) was used to analyze the raw data. The concepts that the students found most difficult were identified; these included the graphical representation of a unit vector, the graphical addition and subtraction of vectors, and the interpretation of the dot and cross products, among others. On the other hand, some concepts were easier for students, such as the magnitude of a vector presented in unit-vector notation, and determination of the components of vectors. No significant differences in understanding of vector concepts could be attributed to gender; however, engineering students outperformed science students in understanding vector concepts. This study offers recommendations that physics instructors and researchers can use to improve the teaching of vector concepts.

show abstract

“…Almost all KCA instruments have been developed using the multiple-choice test (MCT) reaching 92.3% and the rest was developed with the MCT and multiple true false (MTF) format. MCT is a form of assessment that has been widely used in science education to investigate, identify, and assess students' understanding of certain science topics [41]. In fact, many other instruments assessment formats that can be developed include interviews, question test, question test and interviews, multiple choice test, and multiple-tier test.…”

Section: Methodsmentioning

confidence: 99%

Assessment of kinematic concepts comprehension: A systematic review

Jufriadi

Sutopo

Kusairi

et al. 2023

IJERE

View full text Add to dashboard Cite

<span lang="EN-US">A systematic study on the development of the assessment instrument of the concept of kinematics which is one of the basic concepts of physics has not yet been conducted. This systematic study reported the characteristics, quality, effectiveness, and efficiency of the instrument assessment regarding the concept of kinematics. This systematic review method has used a systematic approach based on the practical guidelines of systematic reviews by Petticrew and Roberts and has used PRISMA diagrams for the process of searching and selecting articles, who reviewed 12 articles published between 1985 and 2021. The research findings show that the instrument of concept mastery of kinematics using multiple-choice formats, while others combine the true-false and multiple-choice formats. Almost all instruments of mastery of the concept of widely used kinematics have reported validity assessment (content validity, construct validity) and internal consistency reliability. However, predictive validity, discriminatory validity, and temporal stability reliability have not been reported. Other results indicate that the development of further assessments must pay attention to five important aspects: the validity and reliability of instruments, the scopes and specificity of the concept of kinematics, the conformity with the intellectual level of students, the effectiveness and efficiency of instrument assessment, and the fulfillment of research gaps. This study can help educators and researchers choose and develop an appropriate instrument assessment to reveal students’ understanding of the concept of kinematics.</span>

show abstract

Assessing the Validity and Reliability of Science Multiple Choice Test Using Rasch Dichotomous Measurement Model

Cited by 3 publications

References 29 publications

Implementing next generation science practices in classrooms: Findings from TIMSS 2019

Implementing next generation science practices in classrooms: Findings from TIMSS 2019

Science and engineering students’ difficulties in understanding vector concepts

Assessment of kinematic concepts comprehension: A systematic review

Contact Info

Product

Resources

About