OpenAI ChatGPT Generated Results: Similarity Index of Artificial Intelligence-Based Contents

Ventayen, Randy Joy Magno

doi:10.2139/ssrn.4332664

Cited by 65 publications

(48 citation statements)

References 0 publications

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“…Researchers don't have a crystal ball to predict how the model will perform in the future. Still, it can be conjectured that there will be a threat to academic or scholastic honesty upon the perfection of the system because its output could already pass sophisticated plagiarism detection systems (Ventayen, 2023). The short editorial in this paper also passed five less sophisticated but freely available plagiarism check tools, indicating that ChatGPT paraphrases well, which can be helpful in particular learning or writing instances.…”

Section: Discussionmentioning

confidence: 94%

See 1 more Smart Citation

ChatGPT a breakthrough in science and education: Can it fail a test?

Szabó¹

2023

Preprint

View full text Add to dashboard Cite

Released less than three months ago, ChatGPT became the center of attention of scholars around the world. This artificial intelligence (AI) language model has over 100 million subscribers worldwide and generates many discussions concerning its accuracy, advantages, and threats to science and education. Its accuracy in law, linguistics, mathematics, and medicine has already been evaluated. Most results suggest that ChatGPT could generate a passing grade in these domains. Its performance in combined subjects or social sciences has yet to be tested. The large amount of information in this general area may yield more accurate performance. Still, specific subjects in the field, with controversial research findings, can lead to significant errors, which teachers and researchers could quickly spot. In this study, ChatGPT was tested on its accuracy on exercise addiction, a subject in sports sciences and psychology associated with more than 1,000 publications. ChatGPT gave several correct answers to 20 questions but failed the test with 45%. Its performance was like in other already tested subjects. However, when prompted to write a general introductory editorial on AI’s role in sports, ChatGPT performed well. Plagiarism detectors could not identify the AI-originated text, but AI detectors did. Therefore, it can be concluded that the system does a relatively good job on general issues but needs further development in more specific areas. Students and scholars cannot rely on ChatGPT to do their job. Still, future versions could yield dilemmas of originality since the system does not provide information for its source(s) of information.

show abstract

Section: Discussionmentioning

confidence: 94%

“…For example, the system could refer to non-existent scientific studies (Thorp, 2023). Still, there are more limitations, some substantiated in the academic literature (Ventayen, 2023) and having the potential to be corrected, while others may be more hypothetical at this stage.…”

Section: Introductionmentioning

confidence: 99%

ChatGPT a breakthrough in science and education: Can it fail a test?

Szabó¹

2023

Preprint

View full text Add to dashboard Cite

show abstract

“…Furthermore, new concerns have emerged that academic dishonesty is now more easily facilitated among the academic community due to technological aids such as AI text generators. Academic integrity, adherence to ethical principles in academic work, has always been an institutional priority, emphasizing honesty, trust, fairness, respect, and responsibility (Ventayen, 2023). This includes avoiding plagiarism, cheating, fabrication, and enabling academic dishonesty.…”

Section: Perceptions Of Teachers' Experience Using Aied In Academic W...mentioning

confidence: 99%

Examining the user experience of artificial intelligence tools in academic writing: The perceptions lecturers practices

Shofiah,

Putera

2024

Preprint

View full text Add to dashboard Cite

In academic writing, AI technology has emerged as an innovative solution capable of enhancing the efficiency and quality of students' writing. This study seeks to explore the perspectives of lecturers, who are increasingly interested in and reliant on AI technology to augment the quality of their academic compositions. Furthermore, this study aims to comprehend lecturer' perceptions regarding using artificial intelligence tools in academic writing and how AI technology impacts learning. Grounded in the Technology Acceptance Model (TAM), this research encompasses perceived usefulness, perceived ease of use, attitude towards usage, intention to use behaviour, and actual usage. The study's respondents consist of 10 instructors from three universities in Malang City, Indonesia. First, the research findings indicate that using artificial intelligence tools yields various advantages for lecturer, including grammar checks, plagiarism detection, sentence improvement suggestions, and analyses of content relevance and structural coherence. Second, Instructors positively welcome using AI technology as a supplementary tool to support the learning and research processes; however, concerns about its potential over-dependence might diminish College student abilities to think creatively and critically. The outcomes of this research are expected to inform the development of future interventions aimed at maximizing the benefits of AI technology in education.

show abstract

“…Emerging research has also been done on evaluating ChatGPT in various domains. Ventayen compared ChatGPT generated responses with that of pre-existing human-authored research papers, using the paper's title for the query [13]. The generated texts were then passed through Turnitin, a widely used plagiarism software, and found to pass Pangasinan State University (where the research was conducted) similarity thresholds [13].…”

Section: Related Workmentioning

confidence: 99%

Don’t Worry Accountants, ChatGPT Won’t Be Taking Your Job...Yet

Taylor

Kešelj

2023

Proceedings of the Canadian Conference on Artificial Intelligence

View full text Add to dashboard Cite

ChatGPT has demonstrated the ability to generate plausible human-like text and research is underway to evaluate and benchmark its current performance in various domains. The research we present here provides a preliminary benchmark on ChatGPT's ability to emulate the style and information presented in financial statement note disclosures. Using text from Canada's major banks (n = 5) over the period of 2019-2021, we query ChatGPT to generate two required note disclosures and compare its text against the note disclosures written by the banks in their corporate annual reports. We find that the similarity between ChatGPT's text and the human-authored text is very low, but also find that ChatGPT's text is significantly more readable for one of the two disclosures (p < 0.05).

show abstract

OpenAI ChatGPT Generated Results: Similarity Index of Artificial Intelligence-Based Contents

Cited by 65 publications

References 0 publications

ChatGPT a breakthrough in science and education: Can it fail a test?

ChatGPT a breakthrough in science and education: Can it fail a test?

Examining the user experience of artificial intelligence tools in academic writing: The perceptions lecturers practices

Don’t Worry Accountants, ChatGPT Won’t Be Taking Your Job...Yet

Contact Info

Product

Resources

About