Interactive computer based assessment tasks: How problem-solving process data can inform instruction

Abstract

This article presents key steps in the design and analysis of a computer based problem-solving assessment featuring interactive tasks. The purpose of the assessment is to support targeted instruction for students by diagnosing strengths and weaknesses at different stages of problem-solving. The first focus of this article is the task piloting methodology, which demonstrates the relationship between process data and a priori documented problem-solving behaviours. This work culminated in the design of a Microsoft Excel template for data transcription named a Temporal Evidence Map. The second focus of this article is to illustrate how evidence from process data can be accumulated to produce and report instructionally useful information not available through traditional assessment approaches. This is demonstrated through the production of reports profiling individual student outcomes against important aspects of problem solving.

Generic log files and algorithms developed for educational multiplayer games

“…The games emphasis on collaborative problem solving; some of games were primarily developed by Zoanetti [4] for single student use in computer based problem solving. The development of online games for education has progressed rapidly in current years.…”

Perspectives on Problem Solving in Educational Assessment: Analytical, Interactive, and Collaborative Problem Solving

“…Whereas for analytical problems in PISA 2003, only the final solution of the problem-solving process was available, the process of exploration becomes an issue for further analyses in interactive problems (e.g., Schulte-Mecklenbeck, Kühberger, & Ranyard, 2010;Zoanetti, 2010). In fact, behavioral and process data of problem-solving patterns are now partly implemented in the PISA scoring procedures and directly connected to the emerging field of educational data mining, in which experimental and psychometric methods are applied to large educational data sets (cf.…”

Multiplayer Game Design: Performance Enhancement with Employment of Novel Technology

“…CONSTRUCT2 is an HTML5 based two dimensional (2D) game editor which allows quick creation of games in a drag-and-drop fashion using a graphical editor and a behaviour-based logic system. The games emphasis on collaborative problem solving; some of games were initially developed by Zoanetti (2010) for single student use in computer based problem solving. The expansion of online games for education has advanced quickly in recent years.…”