Development and Validation of a Learning Progression for Astronomical Systems Using Ordered Multiple-Choice Items

Abstract

This study sought to investigate learning progressions for astronomical systems which synthesized the motion and structure of Earth, Earth-Moon system, solar system, and the universe. For this purpose we developed ordered multiple-choice items, applied them to elementary and middle school students, and provided validity evidence based on the consequence of assessment for interpretation of learning progressions. The study was conducted according to construct modeling approach. The results showed that the OMCs were appropriate for investigating learning progressions on astronomical systems, i.e., based on item fit analysis, students' responses to items were consistent with the measurement of Rasch model. Wright map analysis also represented that the assessment items were very effective in examining students' hypothetical pathways of development of understanding astronomical systems. At the lower anchor of the learning progression, while students perceived the change of location and direction of celestial bodies with only two-dimensional earth-based view, they failed to connect the locations of celestial bodies with Earth-Moon system model, and they could recognized simple patterns of planets in the solar system and milky way. At the intermediate levels, students interpreted celestial motion using the model of Earth rotation and revolution, Earth-Moon system, and solar system with space-based view, and they could also relate the elements of astronomical structures with the models. At the upper anchor, students showed the perspective change between space-based view and earth-based view, and applied it to celestial motion of astronomical systems, and they understood the correlation among sub-elements of astronomical systems and applied it to the system model.

Cross-Sectional Item Response Analysis of Geocognition Assessment for the Development of Plate Tectonics Learning Progressions: Rasch Model

“…(King et al, 2008;Libarkin, 2006;Stokes, 2011 Briggs et al, 2006;Alonzo & Steedle, 2009;Maeng et al, 2013, Maeng et al, 2014, 2단계 선다형 문항(two-tiered multiple-choice items, Neumann et al, 2013) …”

Feedback Loop Reasoning and Knowledge Sources for Elementary Students in Three Countries

“…To promote the use of LPs, Wickman (2014) emphasizes the international approach in designing a LP that takes into consideration multiple contexts. Moreover, LP studies from Asian countries include force and motion in Singapore and Hong Kong (Fulmer, 2014, Vyas, 2015, astronomical systems in Korea (Maeng, Lee, Park, Lee, & Oh, 2014), and feedback loop reasoning in Japan (Hokayem et al, 2015). Building upon this research base, an important research venue is using the LPs to compare the learning progressions different regions with students holding different backgrounds.…”

Item Response Analysis of Energy as a Cross-Cutting Concept for Grades 3 to 9

“…학습발달과정 연구 (Shin et al, 2014), 판구조론에 대한 학습발달과정 을 위한 문항반응 연구 (Maeng & Lee, 2015 Maeng et al, 2013;Maeng et al, 2014;Maeng & Lee, 2015;Noh et al, 2016;Seong et al, 2013). • 수준 2: 전구에 불이 켜지는 것은 전지의 에너지가 전구로 전달되 기 때문이다.…”