Automatic assessment of elementary Standard ML programs using Ceilidh

Abstract

Ceilidh is an interactive environment which supports computer programming course organisation, practical work and assessment. This paper describes its use to support a first level programming course for the functional language Standard ML. Automated program assessment systems are surveyed and the general Ceilidh approach to automatic assessment is discussed. Extensions to Ceilidh to assess Standard ML programs are considered and an evaluation is made of the effects of its use on student learning. The main conclusion is that Ceilidh use significantly reduces the burden of marking on the lecturer, while not affecting the overall level of achievement of the students.

Computer-based assessment: a versatile educational tool

“…It is inconceivable to use a computer to assess large, important, predominantly creative projects such as a final year creative writing essay or a final year arts project. Computers are, however, used to assess some large creations, such as computer programs ( Foubister, Michaelson & Tomes, 1997;Foxley, Higgins, & Tsinitsifas, 1998), although a computer program clearly exists in a tightly defined environment and has a relatively small artistic component.…”

The Design of ADAT: A Tool for Assessing Automata-Based Assignments

“…Higgins and Bligh [7] have analyzed whether computer based assessment (CBA) meets pedagogic criteria for measuring the quality of assessment suggested by Brown et al (1996). Table 1, which is taken directly from [7] shows the analysis. Based on the analysis, they concluded that CBA meets 7 out of 10 criteria, therefore CBA can be said to have concrete pedagogic benefits.…”

“…From the modeling aspect, [9] try to formalize automatic marking system in order to have a depth Table 1: Application of assessment criteria to CBA [7] Criterion Application to CBA Valid Will measure specified coursework aspects assuming good initial assessment design Reliable…”

“…Apart from that, many automatic assessment tools for various kinds of subjects such as essays-based assignment [2] (Foxley and Lou, 1994): Diagram-based assignment [17,19] : (Ali et al 2007); as well as the new design of tools for computing program assignments [4,7,9,10,18] have been developed. Automatic assessment tools help educators by providing a consistent, accurate and efficient marking process.…”

The grader in ProgrammingLand

“…Program graders are not new [2], however one of the things that distinguishes TorqueMOODa, is its integration into an existing learning system. A predecessor system [5] had a lesser scope and completely different implementation.…”