On-line programming examinations using Web to teach

A Procedure for Extending Input Selection Algorithms to Low Quality Data in Modelling Problems with Application to the Automatic Grading of Uploaded Assignments

“…However, the resources needed for tracking students and taking examination are time consuming for the organizing institutions; thus, there is demand for intelligent techniques that help the instructor to manage large groups of students. In particular, procedures that partially or completely automate the grading process are sought, understood as taking standardized measurements of varying levels of achievement in a course [ 1 ].…”

“…To name some, in [ 2 ] a semiautomated system for task submission and grading is proposed, but the grading itself must be done manually by the teacher. The WebToTeach system [ 1 ], on the contrary, is able to check submitted source code automatically. Similar to this and focused on programming, the methods in [ 3 ] or [ 4 ] achieve an automatic grading by comparing the output of each student program with the output of a correct program.…”

Experience with a computer-assisted formal programming examination

“…A solution which has been used by several others [1,5,6] is to conduct a formal computer-based examination which allows students access to compilers and other tools so that they can develop and test practical solutions to the questions they have been set. This also has the additional advantage that the submissions will be available in a machine-readable format which is amenable to some form of automated marking system.…”

A System for Automatic Assessment and Plagiarism Detection of Student Programs

“…介绍了一个学生程序自动评判工具，学 生需要将程序提交到服务器指定的目录内，服务器端的 Shell 脚本程序自动对该目录内的源文件进行编译，然后 采用黑盒测试方法进行测试，将测试结果写入指定的文 件。Dawson-Howe 在文献 [7] 中描述了另外一个基于黑盒测 试的自动评判工具，学生通过 Email 提交源程序，评判结 果也通过 Email 返回。WebToTeach [8] 是基于 Web 的程序 自动评判系统，采用黑盒测试方法，该系统支持在线考 试，但不支持抄袭检测。浙江大学和北京大学开发的 Online Judge [9,10] 也可以对程序进行自动评判，该系统也是 基于黑盒测试方法对程序进行正确性测试，但因为该系统 是 ACM 国际大学生编程竞赛训练平台，融入了很多竞赛 的规则，并不适合程序设计课程使用。ASSYST [11] 是利物 浦大学计算机系的 David Jackson 和 Michelle Usher 开发的 基于 C/S 结构的自动评分系统，它从正确性、程序运行效 率、复杂度和程序风格方面对学生程序进行评判，相比以 前只采用黑盒测试对学生程序评判的系统，有了很大的进 步，但该系统不支持抄袭检测，也不支持在线考试。 BOSS [ 12 ] 在线提交系统由英国沃里克大学(University of Warwick)资助开发，支持的评判手段包括：正确性测试， 程序风格度量，程序抄袭检查。该系统只支持 Java 语言 的自动评判，最新的版本集成了 JUnit 测试框架，将测试 驱动开发引入课堂教学，BOSS 系统的程序抄袭检查过程 需要人为调整相似度，能够检查出的抄袭手段很有限。 CourseMaster [13] (现已改名为 CourseMarker)是一个 C/S 结 构的学生程序自动评判系统，可以评判 C、C++和 Java， 支持的评测手段非常丰富，包括：程序正确性，程序风 格，复杂度，程序特征识别，代码静态检查和抄袭检测。 但录入题目的时候，需要编写很多配置文件，易用性方面 有待提高。 抄袭检测方面的研究也非常丰富，Jones [14] 总结了学 生常用的 10 种抄袭手段，在此基础上，本文又增加了常 量替换和表达式拆分两种手段，根据抄袭所付出的努力， 从易到难依次为： …”