Improving Automated Programming Assessments: User Experience Evaluation Using FaSt-generator

Romli, Rohaida; Sulaiman, Shahida; Zamli, Kamal Z.

doi:10.1016/j.procs.2015.12.120

Cited by 9 publications

(15 citation statements)

References 20 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…In conclusion, our results demonstrate the efficacy of EDM, even with a relatively small dataset. We believe that the simple workflow proposed in this paper could easily be replicated by educators via referencing the information and tools provided by the repository of ProgEdu 1 . We claim that the information collected from assignment submissions is valuable for multiple educational purposes, for instance, to improve the assignment design for the next versions of the course, and to be featured for learning analytics related to students' behavior.…”

Section: Discussionmentioning

confidence: 99%

See 1 more Smart Citation

Analysis of Learning Behavior in an Automated Programming Assessment Environment: A Code Quality Perspective

et al. 2020

View full text Add to dashboard Cite

Automated programming assessment systems are useful tools to track the learning progress of students automatically and thereby reduce the workload of educators. They can also be used to gain insights into how students learn, making it easier to formulate strategies aimed at enhancing learning performance. Rather than functional code which is always inspected, code quality remains an essential aspect to which not many educators consider when designing an automated programming assessment system. In this study, we applied data mining techniques to analyze the results of an automated assessment system to reveal unexpressed patterns in code quality improvement that are predictive of final achievements in the course. Cluster analysis is first utilized to categorize students according to their learning behavior and outcomes. Cluster profile analysis is then leveraged to highlight actionable factors that could affect their final grades. Finally, the same factors are employed to construct a classification model by which to make early predictions of the students' final results. Our empirical results demonstrate the efficacy of the proposed scheme in providing valuable insights into the learning behaviors of students in novice programming courses, especially in code quality assurance, which could be used to enhance programming performance at the university level. INDEX TERMS automated programming assessment system, code quality, educational data mining, early learning achievement detection, programming education

show abstract

Section: Discussionmentioning

confidence: 99%

“…APASs are widely accepted by both students and institutions via their fruitful benefits. First, they reduce the educators' workload in code evaluation as well as provide accurate grading and immediate feedback to learners [1].…”

Section: Introductionmentioning

confidence: 99%

Analysis of Learning Behavior in an Automated Programming Assessment Environment: A Code Quality Perspective

et al. 2020

View full text Add to dashboard Cite

show abstract

“…Indeed, a collaboration with Artificial Intelligence (AI) discipline to develop a tool to intelligently design assignment requirements is needed—of course with the instructor's expertise. Creating sufficient set of test cases that can verify all special cases: The student's code will pass through a set of test cases to ensure that the code's functionalities completely cover the requirements. These tests can be created automatically or manually. Thus, it is important to design the test cases in parallel with the assignment requirements to ensure the coverage.…”

Section: Discussion and Recommendationsmentioning

confidence: 99%

“…Tracking errors manually for every program is difficult and time‐consuming [13,17]. Moreover, manual assessment of student coding is rather heavy on instructors and may eventually conclude the reporting of feedback as well as lead to discrepancies [4,41] from more than one instructor in the assessment. Therefore, due to the rapid increase in the number of students in programming courses and to lower the burden of educators in manual assessment, the AA in programming courses has attracted the attention of many researchers as well as academicians.…”

Section: Introductionmentioning

confidence: 99%

The effect of automatic assessment on novice programming: Strengths and limitations of existing systems

Ullah

Lajis

Jamjoom

et al. 2018

Comp Applic In Engineering

View full text Add to dashboard Cite

Computer programming is always of high concern for students in introductory programming courses. High rates of failure occur every semester due to lack of adequate skills in programming. No student can become a programmer overnight because such learning requires proper guidance as well as consistent practice with the programming exercises. The role of instructors in the development of students' learning skills is crucial in order to provide feedback on their errors and improve their knowledge accordingly. On the other hand, due to the large number of students, instructors are also overloading themselves to focus on each individual student's errors. To address these issues, researchers have developed numerous Automatic Assessment (AA) systems that not only evaluate the students' programs but also provide instant feedback on their errors as well as abridge the workload of the instructors. Due to the large pool of existing systems, it is difficult to cover each and every system in one study. Therefore, this paper provides a comprehensive overview of some of the existing systems based on the three‐analysis approaches: dynamic, static, and hybrid. Moreover, this paper aims to discuss the strengths and limitations of these systems and suggests some potential recommendations regarding the AA specifications for novice programming, which may help in standardizing these systems.

show abstract

“…FaSt-generator [21] is based on an automated programming system for Java language. This system allows the teachers to provide a set of test data and the students to develop their programming skills through feedbacks and through learning from their own unexpected mistakes.…”

Section: Sac [14]mentioning

confidence: 99%

Developing an exercise management system for e-learning

Balaa

2016

2016 Sixth International Conference on Digital Information Processing and Communications (ICDIPC)

View full text Add to dashboard Cite

The programming language is not an easy course for beginners. Beginners need additional exercises to improve their learning. A number of webbased systems have been developed in order to allow students to submit their exercises. However, these systems do not define a pedagogical approach that makes programming learning easier. We have developed a tool named Exercise Management System for e-Iearning (EMSEL). It is a web-based learning system that helps the students to learn and assists the instructors to design exercises. This system makes it easier for the student to search exercises through specific criteria and a suitable search engine. EMSEL provides a user-friendly interface that allows the instructors to create exercises (problems and solutions), and the students to submit their solutions and to selfevaluate their programming skills. EMSEL is an extensible system and can be used for several programming languages.

show abstract

Improving Automated Programming Assessments: User Experience Evaluation Using FaSt-generator

Cited by 9 publications

References 20 publications

Analysis of Learning Behavior in an Automated Programming Assessment Environment: A Code Quality Perspective

Analysis of Learning Behavior in an Automated Programming Assessment Environment: A Code Quality Perspective

The effect of automatic assessment on novice programming: Strengths and limitations of existing systems

Developing an exercise management system for e-learning

Contact Info

Product

Resources

About