Will ChatGPT get you caught? Rethinking of Plagiarism Detection

Abstract

The rise of Artificial Intelligence (AI) technology and its impact on education has been a topic of growing concern in recent years. The new generation AI systems such as chatbots have become more accessible on the Internet and stronger in terms of capabilities. The use of chatbots, particularly ChatGPT, for generating academic essays at schools and colleges has sparked fears among scholars. This study aims to explore the originality of contents produced by one of the most popular AI chatbots, ChatGPT. To this end, two popular plagiarism detection tools were used to evaluate the originality of 50 essays generated by ChatGPT on various topics. Our results manifest that ChatGPT has a great po-tential to generate sophisticated text outputs without being well caught by the plagiarism check software. In other words, ChatGPT can create content on many topics with high originality as if they were written by someone. These findings align with the recent concerns about students using chatbots for an easy shortcut to success with minimal or no effort. Moreover, ChatGPT was asked to verify if the essays were generated by itself, as an additional measure of plagiarism check, and it showed superior performance compared to the tradi-tional plagiarism-detection tools. The paper discusses the need for institutions to consider appropriate measures to mitigate potential plagiarism issues and advise on the ongoing debate surrounding the impact of AI technology on education. Further implications are discussed in the paper.

ChatGPT in education: Strategies for responsible implementation

“…This problem makes ChatGPT generated text unsuitable for academic writing (García-Peñalvo, 2023). Issues of plagiarism detection in write-ups generated by ChatGPT have been raised, as well as how to distinguish between fact and fiction text generated (Chatterjee & Dethlefs, 2023;Khalil & Er, 2023). Instructors are increasingly worried that students may use ChatGPT to produce their written assignments, as it has been demonstrated to generate reports in a matter of seconds without being detected by plagiarism detectors.…”

“…Therefore, when using GPT-3, authors or students should make it clear that the model was used and cite or reference it appropriately. Khalil and Er (2023) conducted an experiment to determine whether plagiarism detection tools could detect essays written using ChatGPT, and found that of the 50 essays tested, 40 had a similarity score of 20% or less, demonstrating a high degree of originality. Similarly, Susnjak (2022) used ChatGPT in an experiment to assess its ability to engage in critical thinking rather than simply information retrieval, and the results were highly accurate and precise, as well as logically coherent.…”

“…In order to support the argument presented in this paper, various indicators and facts must be considered. First, experimental research has demonstrated that ChatGPT produces outputs of a high quality that have a high probability of passing plagiarism detection software (Khalil & Er, 2023;Susnjak, 2022) Turnitin (2023) announced that it developed an AI tool that identifies 97% of ChatGPT and GPT-3 authored writing. Thirdly, ChatGPT tool is easily accessible to everyone, thus increasing the likelihood that students and faculty may make use of it.…”

Plagio a la Inteligencia Artificial en estudiantes de bachillerato: un problema real

“…Adicionalmente, destaca como elemento a tener en cuenta, la poca capacidad que tienen los docentes para identificar trabajos con intervención de las IA, a pesar de que en la institución existe la herramienta Turnitin y los profesores están capacitados para utilizarla con eficiencia. Esto concuerda con investigaciones recientes en las que se muestra una reducida eficacia de esta herramienta para detectar los trabajos creados por IAs (Diaz-Arce, 2023; Khalil & Er, 2023;Perkins, 2023;Rudolph et al, 2023). Por ello se resalta la necesidad de insistir no solo en ampliar las políticas internas sobre probidad académica para que incluyan el Plagio IA (plagio a herramientas IA) dentro de sus prohibiciones, sino también en soluciones más integrales y preventivas pues es un problema que puede extenderse rápidamente.…”

“…De este modo, no solo puede recibir instrucciones y ejecutarlas, sino que también la procesa para aprender y mejorar su desempeño respecto a la actividad para la que fue creada (Incio-Flores et al, 2021). Sin dudas, se refiere a un avance tecnológico que puede significar un salto cualitativo y cuantitativo significativo en múltiples aspectos de la sociedad, pero que muchos tienen fundadas preocupaciones respecto al mal uso que se les pueda dar en el ámbito educativo y profesional (Arif et al, 2023;Cotton et al, 2023;Guo et al, 2023;Khalil & Er, 2023;Macdonald et al, 2023;Perkins, 2023;Rudolph et al, 2023;Susnjak, 2022).…”