One issue within current product development literature entails, both with students and with professionals, the reliable scaling, and the objective assessment of products. This article will attempt to describe a way how master's students at the University of Antwerp, within a product development case, can both assess each other, assess the process of product development, and assess the final product using comparative judgement (CJ). This, while achieving learning goals described at master level. Our evaluation was anchored by use of Comproved, a validated instrument designed to comparatively evaluate products of students, during the design process (formative) and when uploading the final deliverables (summative) for the course. The current study evaluates how first year Master students (n=72) apply CJ using an online tool, Comproved (Comproved.com) during a semester-long group project on Product-Service System (PSS) design. Based on post hoc questionnaire details and interviews, we will list the advantages and the disadvantages of CJ, as stated by students. Finally, we will list the potentials of CJ during product development cycles and their impact on product quality, reliability of judgement and metacognitive strategies for learning.