Automated Assessment of Android Exercises with Cloud-native Technologies

Bruzual, Daniel; Freire, Maria L. Montoya; Francesco, Mario Di

doi:10.1145/3341525.3387430

Cited by 11 publications

(11 citation statements)

References 21 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…However, in order to allow tests to run successfully on student code, they had to impose restrictions to the UI (including on identifiers names), and when they did not put any further restriction in the last phase of development, not to limit the creativity of student, this greatly reduced the success rate. Bruzual et al [8] presented a system for automated assessment of Android exercises carried out by running exercise-specific unit tests on the APK file, relieving the tutor from the need to compile the student's submission. However, while this approach seems to scale well, ignoring the source code can limit the possibility to offer more insightful feedback to students.…”

Section: Discussionmentioning

confidence: 99%

A Script-based Approach for Teaching and Assessing Android Application Development

Modesti

2021

ACM Trans. Comput. Educ.

View full text Add to dashboard Cite

Mobile applications are extremely popular with many higher education institutions offering courses to prepare new developers sought by the software industry. However, teaching and assessing mobile application development poses specific challenges due to the complexity of real-world programming languages and environments. In this work, we present a script-based approach for teaching and assessing Android application development that addresses shortcomings of existing tools that impact negatively on the learning experience. Our evaluation, which covers pedagogical and technical aspects, provides possible evidence that the scripts have been beneficial in helping students to work more efficiently and achieve better results. Additionally, the scripts have been effective in streamlining the grading process and keeping the tutorial material up to date with the evolution of the Android platform.

show abstract

Section: Discussionmentioning

confidence: 99%

A Script-based Approach for Teaching and Assessing Android Application Development

Modesti

2021

ACM Trans. Comput. Educ.

View full text Add to dashboard Cite

show abstract

“…The goal is to measure how well the submitted code does what it is meant to do. In [32], the authors propose a system to automatically assess that some functionalities have been correctly implemented as an Android mobile application. In [33], submitted codes are run against tests to check whether they conform to the requirements defined by instructors.…”

Section: Code Semanticmentioning

confidence: 99%

“…Other kinds of feedback are also possible. In [32], the authors propose to include a screenshot of the mobile application just before a failure is detected, to help learners debug their code. This screenshot can also be used for learners to interpret the test results and the possible error stack trace.…”

Section: Other Kinds Of Feedbackmentioning

confidence: 99%

“…In addition, in the review presented in [1], three generations of automated code assessment systems are described. A possible fourth one could be tools implemented as an API, as cloud services or following a Learning Tools Interoperability (LTI) interface, making it easier to integrate them in learning management systems [32,59].…”

Section: Collaboration and Interoperabilitymentioning

confidence: 99%

See 1 more Smart Citation

Automated Code Assessment for Education: Review, Classification and Perspectives on Techniques and Tools

Combéfis

2022

Software

View full text Add to dashboard Cite

Automatically assessing code for learning purposes is a challenging goal to achieve. On-site courses and online ones developed for distance learning both require automated ways to grade learners’ programs to be able to scale and manage a large public with a limited teaching staff. This paper reviews recent automated code assessment systems. It proposes a systematic review of the possible analyses they can perform with the associated techniques, the kinds of produced feedback and the ways they are integrated in the learning process. It then discusses the key challenges for the development of new automated code assessment systems and the interaction with human grading. In conclusion, the paper draws several recommendations for new research directions and for possible improvements for automatic code assessment.

show abstract

“…This approach is not scalable especially in the context of online courses such as SuaCode with thousands of learners. In addition, although research and development has been done to automate assessment of some graphical and mobile application assignments, none has been done for emerging languages geared towards the emerging Interactive Arts such as the Processing language [2,9,25]. Moreover, none are fully integrated to an online course system and none perform syntax, semantic, style in addition to dynamic analysis.…”

Section: Introductionmentioning

confidence: 99%

AutoGrad: Automated Grading Software for Mobile Game Assignments in SuaCode Courses

Annor¹,

Boateng²,

Kayang³

et al. 2021

Preprint

View full text Add to dashboard Cite

Automatic grading systems have been in existence since the turn of the half-century. Several systems have been developed in the literature with either static analysis and dynamic analysis or a hybrid of both methodologies for computer science courses. This paper presents AutoGrad, a novel portable cross-platform automatic grading system for graphical Processing programs developed on Android smartphones during an online course. AutoGrad uses Processing, which is used in the emerging Interactive Media Arts, and pioneers grading systems utilized outside the sciences to assist tuition in the Arts. It also represents the first system built and tested in an African context across over thirty-five countries across the continent. This paper first explores the design and implementation of AutoGrad. AutoGrad employs APIs to download the assignments from the course platform, performs static and dynamic analysis on the assignment to evaluate the graphical output of the program, and returns the grade and feedback to the student. It then evaluates Au-toGrad by analyzing data collected from the two online cohorts of 1000+ students of our SuaCode smartphone-based course. From the analysis and students' feedback, AutoGrad is shown to be adequate for automatic assessment, feedback provision to students, and easy integration for both cloud and standalone usage by reducing the time and effort required in grading the 4 assignments required to complete the course. CCS CONCEPTS• Applied computing → E-learning; Computer-assisted instruction; • Software and its engineering → Application specific development environments.

show abstract

Automated Assessment of Android Exercises with Cloud-native Technologies

Cited by 11 publications

References 21 publications

A Script-based Approach for Teaching and Assessing Android Application Development

A Script-based Approach for Teaching and Assessing Android Application Development

Automated Code Assessment for Education: Review, Classification and Perspectives on Techniques and Tools

AutoGrad: Automated Grading Software for Mobile Game Assignments in SuaCode Courses

Contact Info

Product

Resources

About