Automated Assessment in Computer Science Education: A State-of-the-Art Review

Abstract

Practical programming competencies are critical to the success in computer science education and go-to-market of fresh graduates. Acquiring the required level of skills is a long journey of discovery, trial and error, and optimization seeking through a broad range of programming activities that learners must perform themselves. It is not reasonable to consider that teachers could evaluate all attempts that the average learner should develop multiplied by the number of students enrolled in a course, much less in a timely, deeply, and fairly fashion. Unsurprisingly, exploring the formal structure of programs to automate the assessment of certain features has long been a hot topic among CS education practitioners. Assessing a program is considerably more complex than asserting its functional correctness, as the proliferation of tools and techniques in the literature over the past decades indicates. Program efficiency, behavior, readability, among many other features, assessed either statically or dynamically, are now also relevant for automatic evaluation. The outcome of an evaluation evolved from the primordial boolean values to information about errors and tips on how to advance, possibly taking into account similar solutions. This work surveys the state-of-the-art in the automated assessment of CS assignments, focusing on the supported types of exercises, security measures adopted, testing techniques used, type of feedback produced, and the information they offer the teacher to understand and optimize learning. A new era of automated assessment, capitalizing on static analysis techniques and containerization, has been identified. Furthermore, this review presents several other findings from the conducted review, discusses the current challenges of the field, and proposes some future research directions.

Capacity Building Needs of Home Economics Lecturers for Computer Assisted Teaching of Pattern Drafting for Entrepreneurship in South East Nigeria

“…They recommended that the university be encouraged to adopt a radical internal income generation strategy in order to keep up with the rapidly changing field of computer-based technology. This is especially true for educators, who must now, out of necessity, keep up with current trends in computer-driven education in order to maintain their job relevance (Paiva et al, 2022). Overall, this article's list of issues ranked the requirement for computer literacy among lecturers highest.…”

Formative assessment strategies for students' conceptions—The potential of learning analytics

“…A recent literature review by Paiva et al (2022) continues in this research direction and gives an overview of the state‐of‐the‐art of automatic assessment in computer science education (with a focus on programming exercises). They additionally also consider aspects of LA and find that only 3 out of 30 assessment tools offer more than simple statistics for the teachers; those three tools provide in particular insights into the program development process of the learners (Paiva et al, 2022, Table 7). The authors furthermore conclude that a significant gap in this field is the lack of a standardised data format; this has partly been addressed by the proposal of Price et al (2020).…”

Mobile Application Prototype: Learning in the Programming Course in Computer Engineering Students

“…Obviously, this does not suit the era of mobile computing that aims to enable students to learn programming skills anytime, anywhere, thereby enhancing the learning of programming languages. A research project started more than a year ago and aims to create a serious gaming approach related to mobile devices along with an educational game for learning programming To date, the project has conducted a literature review to understand the existing work and identify problems in the field, conducted surveys to find out the needs of students for a mobile device based approach and then set up a serious mobile device based gaming approach with a developed prototype of the game [17]. It is expected that the presented project will be useful and helpful to integrate more effective approaches with didactic mobile games for learning object oriented programming in such a way to enhance the learning experience for university students.…”