Peer assessment and individual contribution analysis for measuring collaborative problem solving capability

Abstract

Accurately measuring collaborative problem-solving capability (CPSC) is not only important in itself, but also in order to develop education and training programs. However, most existing CPSC measurement tools have two weaknesses: not accounting for individual’s contribution to the final outcome and relying on predefined problems. Addressing these limitations, we extended criteria of the PISA 2015 framework to consider individual’s contribution to the final outcome, and introduced peer assessment. To test the validity of our proposition, we conducted a study with fifty-one participants, performing two tasks in different groups. We found a strong correlation between the existing CPSC score and our extended CPSC score. And extended CPSC scores from peers approximated extended CPSC scores from expert. Furthermore, extended CPSC scores from peers showed the consistency across different tasks and groups. These results suggest that our proposition can be used to measure CPSC while addressing two limitations.