Increasing the similarity of programming code structures to accelerate the marking process in a new semi-automated assessment approach

Buyrukoğlu, Selim; Batmaz, Firat; Lock, Russell

doi:10.1109/iccse.2016.7581609

Cited by 7 publications

(5 citation statements)

References 22 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Manual programming assessment is time-consuming (Buyrukoglu, Batmaz, & Lock, 2016). Due to increased student numbers, more manpower is needed to deal with the increase in the assessment workload.…”

Section: Introductionmentioning

confidence: 99%

Investigating the Feasibility of Automatic Assessment of Programming Tasks

Liebenberg

Pieterse

2018

JITE:IIP

View full text Add to dashboard Cite

Aim/Purpose: The aims of this study were to investigate the feasibility of automatic assessment of programming tasks and to compare manual assessment with automatic assessment in terms of the effect of the different assessment methods on the marks of the students. Background: Manual assessment of programs written by students can be tedious. The assistance of automatic assessment methods might possibly assist in reducing the assessment burden, but there may be drawbacks diminishing the benefits of applying automatic assessment. The paper reports on the experience of a lecturer trying to introduce automated grading. Students’ solutions to a practical Java programming test were assessed both manually and automatically and the lecturer tied the experience to the unified theory of acceptance and use of technology (UTAUT). Methodology: The participants were 226 first-year students registered for a Java programming course. Of the tests the participants submitted, 214 were assessed both manually and automatically. Various statistical methods were used to compare the manual assessment of student’s solutions with the automatic assessment of the same solutions. A detailed investigation of reasons for differences was also carried out. A further data collection method was the lecturer’s reflection on the feasibility of automatic assessment of programming tasks based on the UTAUT. Contribution: This study enhances the knowledge regarding benefits and drawbacks of automatic assessment of students’ programming tasks. The research contributes to the UTAUT by applying it in a context where it has hardly been used. Furthermore, the study is a confirmation of previous work stating that automatic assessment may be less reliable for students with lower marks, but more trustworthy for the high achieving students. Findings: An automatic assessment tool verifying functional correctness might be feasible for assessment of programs written during practical lab sessions but could be less useful for practical tests and exams where functional, conceptual and structural correctness should be evaluated. In addition, the researchers found that automatic assessment seemed to be more suitable for assessing high achieving students. Recommendations for Practitioners: This paper makes it clear that lecturers should know what assessment goals they want to achieve. The appropriate method of assessment should be chosen wisely. In addition, practitioners should be aware of the drawbacks of automatic assessment before choosing it. Recommendation for Researchers: This work serves as an example of how researchers can apply the UTAUT theory when conducting qualitative research in different contexts. Impact on Society: The study would be of interest to lecturers considering automated assessment. The two assessments used in the study are typical of the way grading takes place in practice and may help lecturers understand what could happen if they switch from manual to automatic assessment. Future Research: Investigate the feasibility of automatic assessment of students’ programming tasks in a practical lab environment while accounting for structural, functional and conceptual assessment goals.

show abstract

Section: Introductionmentioning

confidence: 99%

Investigating the Feasibility of Automatic Assessment of Programming Tasks

Liebenberg

Pieterse

2018

JITE:IIP

View full text Add to dashboard Cite

show abstract

“…Wu et al designed practice teaching and assessment methods around an online judge system and proposed resolution methods for existing problems in hybrid learning [17]. Semi-automatic evaluation methods that focus on reducing the burden on teachers have also been proposed [18]. In this approach, students are grouped according to the structure of their source code submitted to the online judge, and guidance is provided for each group.…”

Section: Related Researchmentioning

confidence: 99%

Logic Error Detection System based on Structure Pattern and Error Degree

Yoshizawa¹,

Watanobe²

2019

Adv. sci. technol. eng. syst. j.

View full text Add to dashboard Cite

The importance of programming skills has increased with advances in information and communication technology (ICT). However, the difficulty of learning programming is a major problem for novices. Therefore, we propose a logic error detection algorithm based on structure patterns, which are an index of similarity based on abstract syntax trees, and error degree, which is a measure of appropriateness for feedback. We define structure patterns and error degree and present the proposed algorithm. In addition, we develop a Logic Error Detector (LED) Application Programming Interface (API) based on the proposed algorithm. An implementation of the proposed algorithm is used in experiments using actual data from an e-learning system. The results show that the proposed algorithm can accurately detect logic errors in many programs solving problems in the Introduction to Programming set.

show abstract

“…The use of more up-to-date mathematical models and applications has become essential to increase the efficiency of methane production. Recently, artificial intelligence technologies have been used to make effective and accurate coal gasification and methanation systems and to obtain statistical results [13], [14]. Today, with the discovery of optimizationbased technologies such as genetic algorithms and PSO, artificial intelligence methods such as machine learning, artificial neural networks, and even deep learning with feature selection are frequently used for coal methaneization and gasification.…”

Section: Introductionmentioning

confidence: 99%

Birleştirilmiş kömür gazlaştırma ve metanlaştırma sisteminin parçacık sürü optimizasyon yöntemiyle performans değerlendirmesi

Herdem

Yalçın

2022

Bitlis Eren Üniversitesi Fen Bilimleri Dergisi

View full text Add to dashboard Cite

Carbon dioxide hydrogenation is a promising method of producing alternative fuels in an environmentally friendly way. Researchers in the current literature have mainly investigated the performance of carbon dioxide hydrogenation systems that use carbon dioxide from various sources and hydrogen from water electrolysis units. In the present study, the performance of a combined coal gasification and methanation unit is investigated to produce methane and power. The carbon dioxide and hydrogen for the methanation unit are provided from the coal gasification system. A Particle swarm optimization (PSO) method is applied to optimize the carbon dioxide and hydrogen values here. Therefore, the water electrolysis unit, which needs high amounts of energy is removed from the system, effectively. The results from the studied system showed that it is possible to produce ~225 kilotons of methane annually by using ~946 kilotons of coal per year. In addition, the results revealed that annual carbon dioxide utilization of ~624.3 kilotons is possible. The system efficiency is estimated at around 49%.

show abstract

Increasing the similarity of programming code structures to accelerate the marking process in a new semi-automated assessment approach

Cited by 7 publications

References 22 publications

Investigating the Feasibility of Automatic Assessment of Programming Tasks

Investigating the Feasibility of Automatic Assessment of Programming Tasks

Logic Error Detection System based on Structure Pattern and Error Degree

Birleştirilmiş kömür gazlaştırma ve metanlaştırma sisteminin parçacık sürü optimizasyon yöntemiyle performans değerlendirmesi

Contact Info

Product

Resources

About