In the opening paper in this Special Edition I outlined the major issues that led to the establishment of project e-scape. The project was intended to develop systems and approaches that enabled learners to build real-time web-based portfolios of their performance (initially) in design & technology and additionally to build systems and approaches to facilitate the web-based assessment of those portfolios. The project was commissioned by the Qualifications and Curriculum Authority (QCA) with additional 'buy-in' from Awarding Bodies-who were seen by QCA as the leading beneficiaries of a successful project. The project was designed in three phases. I have outlined-in the Introduction to this Special Edition-the early exploratory work that we undertook within phase 1, the aim of which was to prove the viability of the concept. This was achieved, and QCA then commissioned phase 2 with a brief to build a working prototype system and run it through a national pilot-testing programme in 2006. Age 15 was the target age-group, aligning as closely as we could with the Awarding Body requirements for the General Certificate of Secondary Education (GCSE) that runs with age 16 learners. The successes of the phase 2 prototype-both as classroom activity and as reliable assessment-led QCA and Becta (the body responsible for funding ICT developments in schools) to commission phase 3 in which we explored the potential of the e-scape system for wider application. Specifically, we were required to demonstrate the transferability of the system to other curriculum areas beyond design & technology, and the scalability of the system if it were to be used for national assessment purposes, with hundreds of thousands of candidates. In this paper, I outline the approach that we adopted through the e-scape research; describe the major elements of the work both in terms of classroom/curriculum practice and in terms of new approaches to assessment; and analyse some of the key issues that arise from it.

In this article I describe the context within which we developed project e-scape and the early work that laid the foundations of the project. E-scape (e-solutions for creative assessment in portfolio environments) is centred on two innovations. The first concerns a web-based approach to portfolio building; allowing learners to build their portfolios in real-time, directly from hand-held peripheral technologies in studios, workshops, laboratories, and from off-site settings. The second concerns the development of a radical webbased approach to the assessment of performance as captured in these portfolios. In many parts of the world, portfolios feature as part of school-based assessments-including those undertaken for school-leaving and certification purposes. In this setting assessment reliability is critical and (judged by practice in England & Wales) is typically far from satisfactory. The approach developed within e-scape has radically improved assessment reliability. Whilst these two innovations represent the most dramatic outcomes of the project, they arose from a set if principles held by the team of researchers in the Technology Education Research Unit (TERU) at Goldsmiths University of London. And central to these principles is that both the portfolio and the assessment approaches should be embedded in a view of active learning, such that engagement with them has a positive impact on classroom practice. As the title suggests, this paper outlines the origins, underlying principles and early development of project e-scape.

No abstract

Conventional approaches to assessment involve teachers and examiners judging the quality of learners work by reference to lists of criteria or other ‘outcome’ statements. This paper explores a quite different method of assessment using ‘Adaptive Comparative Judgement’ (ACJ) that was developed within a research project at Goldsmiths University of London between 2004 and 2010. The method was developed into a tool that enabled judges to distinguish better/worse performances not by allocating numbers through mark schemes, but rather by direct, holistic, judgement. The tool was successfully deployed through a series of national and international research and development exercises. But game-changing innovations are never flaw-less first time out (Golley, Jet: Frank Whittle and the Invention of the Jet Engine, Datum Publishing, Liphook Hampshire, 2009; Dyson, Against the odds: an autobiography, Texere Publishing, Knutsford Cheshire, 2001) and a series of careful investigations resulted in a problem being identified within the workings of ACJ (Bramley, Investigating the reliability of Adaptive Comparative Judgment, Cambridge Assessment Research Report, UK, Cambridge, 2015). The issue was with the ‘adaptive’ component of the algorithm that, under certain conditions, appeared to exaggerate the reliability statistic. The problem was ‘worked’ by the software company running ACJ and a solution found. This paper reports the whole sequence of events—from the original innovation, through deployment, the emergent problem, and the resulting solution that was published at an international conference (Rangel Smith and Lynch in: PATT36 International Conference. Research & Practice in Technology Education: Perspectives on Human Capacity and Development, 2018) and subsequently deployed within a modified ACJ algorithm.

No abstract