Paper Or IDE?

Corley, Jonathan; Stănescu, Ana Maria Alexandra; Baumstark, Lewis; Orsega, Michael C.

doi:10.1145/3328778.3366857

Cited by 9 publications

(8 citation statements)

References 14 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Inspired by assignments like the Binary Bomb assessment [22], our unique exam framework creates distinct exams from a single exam skeleton to mitigate the risk of broadcasted, online exam posting when administering exams remotely. Because our framework is a small adjustment to the exam content-and not the exam medium-it can be easily adapted to both paper exams and software/IDE exams [9,23].…”

Section: Background and Related Workmentioning

confidence: 99%

Pensieve

Yan

Piech

2019

Proceedings of the 50th ACM Technical Symposium on Computer Science Education

View full text Add to dashboard Cite

Educators have faced new challenges in effective course assessment during the recent, unprecedented shift to remote online learning during the COVID-19 pandemic. In place of typical proctored, timed exams, instructors must now rethink their methodology for assessing course-level learning goals. Are exams appropriate-or even feasible-in this new online, open-internet learning environment? In this experience paper, we discuss the unique exams framework: our framework for upholding exam integrity and student privacy. In our Probability for Computer Scientists Course at an R1 University, we developed autogenerated, unique exams where each student had the same four problem skeletons with unique numeric variations per problem. Without changing the process of the traditional exam, unique exams provide a layer of security for both students and instructors about exam reliability for any classroom environment-in-person or online. In addition to sharing our experience designing unique exams, we also present a simple end-to-end tool and example question templates for different CS subjects that other instructors can adapt to their own courses.

show abstract

Section: Background and Related Workmentioning

confidence: 99%

Pensieve

Yan

Piech

2019

Proceedings of the 50th ACM Technical Symposium on Computer Science Education

View full text Add to dashboard Cite

show abstract

“…Nevertheless, regardless of the existing IDE scaffolds and documentation, learners assessed on the computer still exhibited persistent errors such as incorrect calculations and base cases. On the other hand, Corley et al [4] found no difference in the performance between learners using an IDE format exam or a paper one. However, the authors reported significant differences when referring to syntax errors: learners assessed with the IDE format exam demonstrated fewer syntax errors because they had access to scaffolds, whereas those assessed on paper did not.…”

Section: Introductionmentioning

confidence: 96%

“…IDEs provide learners and developers with tools to visualize program structure and code syntax, assisting in the development of scripts and programs. Although the common IDEs for Java involve scaffolding features used in learning and industrial scenarios (e.g., views and controllers created from model classes; code created from UML diagrams), the usage of these tools can make learners rely on the computer as a medium of understanding [4].…”

Section: Introductionmentioning

confidence: 99%

See 1 more Smart Citation

Write2Code: Pen-Based Educational Tool for Java

Feijóo-García

Chen

Esmaeili

et al. 2021

Int. J. Emerg. Technol. Learn.

View full text Add to dashboard Cite

Java instruction generally involves the use of Integrated Development Envi-ronments (IDEs) to assist learners in understanding program structure and code syntax. However, the usage of IDEs can make learners’ understanding dependent on the computer, which makes it challenging for them to transi-tion to write their solutions by hand for programming assessments and cod-ing interviews. Research suggests that handwriting slows down learners’ thinking processes, helping them to better reflect on and engage in problem-solving contexts. We developed Write2Code, a handwriting-recognition ap-plication, to scaffold students’ learning of code syntax and logic by recog-nizing Java input from their handwritten text. In this paper, we present the tool’s architecture, features, and third-party technologies. We also describe how our design helps learners understand Java through an interface that promotes an unplugged experience with feedback similar to an IDE.

show abstract

“…P&P programming tests are still used but are perceived as an artificial scenario that may not fully assess students' ability to develop program code (Bennedsen & Caspersen, 2007). Recent research suggests that there is no significant difference in student test performance between using an IDE or a P&P exam (Corley et al, 2020;Öqvist & Nouri, 2018). Consequently, P&P-based tests still offer a suitable measure of students' programming ability and provide various advantages, including evaluating their capacity to reason about code without relying on IDEs, assessing theoretical understanding, reducing susceptibility to plagiarism, and being easier to invigilate compared to IDE tests.…”

Section: Introductionmentioning

confidence: 99%

IDE vs. pen-and-paper showdown - Performance and perceptions of testing first-year IT students’ programming skills

Harris,

Von Itzstein,

Kelly

et al. 2023

APUBS

View full text Add to dashboard Cite

This study analysed first-year IT students' performance and perceptions of using Integrated Development Environment (IDE) versus pen and paper (P&P) based programming testing methods. 68 participants completed two programming tests using both testing methods, and the results were evaluated on complexity, quality and other criteria. No significant difference was observed in the average scores between the two test methods. However, IDE testing showed fewer syntax errors and lower cyclomatic complexity, indicating the potential advantages of IDE's error-checking. IDE tests exhibited higher variability in student performance, suggesting varying comfort levels with the test environment. Additionally, a weaker correlation existed between actual and perceived performance in IDE tests, highlighting challenges in self-evaluation within a digital framework. Most students preferred IDE-based testing, citing efficiency, user-friendliness, and real-time feedback. Nonetheless, a minority recognised the value of P&P tests for demonstrating deep syntax understanding. This research enhances our understanding of programming pedagogy and assessment.

show abstract

Paper Or IDE?

Cited by 9 publications

References 14 publications

Pensieve

Pensieve

Write2Code: Pen-Based Educational Tool for Java

IDE vs. pen-and-paper showdown - Performance and perceptions of testing first-year IT students’ programming skills

Contact Info

Product

Resources

About