Creating coupled-multiple response test items in physics and engineering for use in adaptive formative assessments

Rios, L. A.; Lutz, Benjamin David; Rossman, Eileen W.; Yee, Christina; Trageser, Dominic; Nevrly, Maggie; Philips, Megan; Self, Brian P.

doi:10.1109/fie44824.2020.9274052

Cited by 3 publications

(2 citation statements)

References 28 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…In this paper, we explore a method for developing a CMR that explores Newton's Second Law for a dynamics course. This process has also been used across many STEM courses [3].…”

Section: Introductionmentioning

confidence: 99%

Generating Coupled Multiple Response Questions to Assess Student Understanding of Newton’s Second Law

Nevrly,

Phillips,

Rossman

et al.

2021 ASEE Pacific Southwest Conference - "Pushing Past Pandemic Pedagogy: Learning From Disruption" Proceedings

View full text Add to dashboard Cite

pursuing a Bachelor of Science in Mechanical Engineering expecting to graduate in June 2021. She enjoys working as a learning assistant for the Department of Mechanical Engineering at California Polytechnic State University since January 2020. In this role, she assists student learning in undergraduate dynamics and statics classes with difficult mechanics concepts. She also participates in research to include social justice topics in a mechanical systems design course.

show abstract

“…In this paper, we explore a method for developing a CMR that explores Newton's Second Law for a dynamics course. This process has also been used across many STEM courses [3].…”

Section: Introductionmentioning

confidence: 99%

Generating Coupled Multiple Response Questions to Assess Student Understanding of Newton’s Second Law

Nevrly,

Phillips,

Rossman

et al.

2021 ASEE Pacific Southwest Conference - "Pushing Past Pandemic Pedagogy: Learning From Disruption" Proceedings

View full text Add to dashboard Cite

show abstract

“…The engineering mechanics introductory sequence (Physics I, Statics, Dynamics) is one such gateway sequence that requires strong foundational knowledge [9], but students often have variable prerequisite knowledge and skills [10]. Fostering a lasting understanding and retention of foundational concepts remains a challenge for faculty and students [11]. Although personalized learning is a key pathway to providing the necessary support for prerequisite remediation, it is challenging to achieve high-quality personalization in large classes.…”

Section: Introductionmentioning

confidence: 99%

An Adaptive Learning Engineering Mechanics Curricular Sequence

Saul,

Howard,

Webster

et al.

2022 ASEE Annual Conference &Amp; Exposition Proceedings

View full text Add to dashboard Cite

show abstract

Student-Tool Interactions from a Conceptually Challenging Adaptive Learning Module for Materials Science

Nigon,

Tucker,

Koretsky

2024 ASEE Annual Conference &Amp; Exposition Proceedings

View full text Add to dashboard Cite

The use of computers as automated adaptive instructional tools to support students in STEM education continues to grow. However, these tools often focus on development of declarative knowledge and procedural skills; it is uncommon and challenging to develop adaptive learning tools that specifically focus on developing conceptual understanding. In part, this difficulty stems from limited understanding of how students' conceptual knowledge emerges through interaction with these adaptive tools. In a previous study, we have explained the components and how we quantitatively tested the adaptive logic of a newly developed Crystallography Adaptive Learning Module (CALM) in materials science. In the current study, we use a knowledge-in-pieces framework that views learning as the activation and coordination of resources. We seek to identify and explicate student-tool interactions that may lead to or hinder the activation of conceptual resources leading to canonical understanding. Utilizing a qualitative think-aloud design, four students completed the CALM while being recorded and prompted to explain their thinking. Sessions lasted two to three hours per participant. Audio recordings of students thinking aloud were supplemented by video recordings of their screens as they completed the module. We also collected and analyzed the notes they wrote as they completed the CALM. Comparing across the four cases, the activation and coordination of resources was more idiosyncratic than we previously envisioned. For example, part of the CALM contains three twopart multiple-choice questions used for formative assessment with the initial question asking a conceptually challenging question and the follow-up question having the students select a response that aligns with their reasoning. We constructed the possible choices for reasons in the second question based on our analysis of students' free responses in previous terms. While students found the follow-up choices provided on some questions align with their initial reasoning when they selected the answer from the first approach, on most questions they rethought their choice based on the reasons provided. There were also instances where students responded based on how they interpreted the tool's response should be. For example, the summative assessment was designed to be adaptive with students who answered a question correctly receiving a more difficult question and those who did not answer correctly receiving a less difficult question. However, sometimes, when correct, a student interpreted a similar question as an indication they were incorrect the first time. We also describe differences in the ways students negotiated uncertainty and how they engaged in the more extensive instructional tools. This paper contributes both to how students conceptually engage with complex materials science content and how student-technology interactions can support or hinder learning.

show abstract

Creating coupled-multiple response test items in physics and engineering for use in adaptive formative assessments

Cited by 3 publications

References 28 publications

Generating Coupled Multiple Response Questions to Assess Student Understanding of Newton’s Second Law

Generating Coupled Multiple Response Questions to Assess Student Understanding of Newton’s Second Law

An Adaptive Learning Engineering Mechanics Curricular Sequence

Student-Tool Interactions from a Conceptually Challenging Adaptive Learning Module for Materials Science

Contact Info

Product

Resources

About