Bringing together manual and automated code assessment

Abstract

This paper presents an effort to incorporate assessment of manually assessed aspects in an automated code assessment process. Fully automated code assessment has its drawbacks which makes manual assessment of some aspects of student solutions a necessity. In most situations during the assessment of code written by students the most appropriate approach would thus be splitting the process in two phases -automatic plus manual. This might result in two completely distinct procedures for each of the phases. The solution proposed in this paper tries to join these procedures into one uniform process keeping the benefits from each.

Automated Code Assessment for Education: Review, Classification and Perspectives on Techniques and Tools

“…Even if they contribute a lot in helping both instructors and learners, future developments should probably be focused on approaches combining automated and human grading. In [124], automated and manual assessments have been fully integrated, manual interventions being required all along the automatic grading. Such an approach that is not limited to the usual sequential one with a clear split between automatic and manual phases should maybe be explored more in the future.…”

Paradigm and Architecture of Computing Augmented Learning Management System for Computer Science Education

“…Automated assessment systems are very helpful in reducing the amount of repetitive work done by instructors on programming courses with a lot of practical exercises and feedbacks (Pribela et al, 2012). Assessing and providing feedback on computer programs is time consuming, because there are many fundamental aspects relating to good programming that need to be considered (Ala-Mutka, 2005).…”

“…Similarly, Testovid system provides hints and advices into the student testing reports, enabling graders to give learners comprehensible feedback about their programming solutions (Pribela et al, 2007). Testovid is the testing system implemented by using Apache Ant that allows students to test their assignments in a systematic manner (Pribela et al, 2012). The system allows instructor to run the same tests on a set of student assignments.…”

“…The results of the test are recorded in a log file and are available to students and instructors. The system is independent of underlying platform and programming language used for solutions (Pribela et al, 2012). Testovid is based on modern technology that generates XML as data representation and is platform programming language independent.…”