Impact of ChatGPT on ESL students’ academic writing skills: a mixed methods intervention study

Abstract

This paper presents a study on the impact of ChatGPT as a formative feedback tool on the writing skills of undergraduate ESL students. Since artificial intelligence-driven automated writing evaluation tools positively impact students’ writing, ChatGPT, a generative artificial intelligence-propelled tool, can be expected to have a more substantial positive impact. However, very little empirical evidence regarding the impact of ChatGPT on writing is available. The current mixed methods intervention study tried to address this gap. Data were collected from tertiary level ESL students through three tests and as many focus group discussions. The findings indicate a significant positive impact of ChatGPT on students' academic writing skills, and students’ perceptions of the impact were also overwhelmingly positive. The study strengthens and advances theories of feedback as a dialogic tool and ChatGPT as a reliable writing tool, and has practical implications. With proper student training, ChatGPT can be a good feedback tool in large-size writing classes. Future researchers can investigate the impact of ChatGPT on various specific genres and micro aspects of writing.

EFL Learners’ English Writing Feedback and Their Perception of Using ChatGPT

“…The performance of students in the EG compared to the CG in terms of writing quality aligns with findings from prior research (Cheng, 2017;Liao, 2016;Mahapatra, 2024;Wang et al, 2013). These studies have highlighted the benefits of AI tools in offering instantaneous grammar feedback, which proves particularly advantageous for EFL students during the drafting and proofreading stages.…”

“…Research related to ChatGPT has been investigated recently (Mizumoto & Eguchi, 2023;Rudolph et al, 2023;Wang & Guo, 2023). Mahapatra (2024) investigated the impact of ChatGPT as a formative feedback tool on the writing skills of undergraduate ESL students. Data were collected from tertiary level ESL students and the findings indicate a significant positive impact of ChatGPT on students' academic writing skills, and students' perceptions of the impact were also overwhelmingly positive.…”

Generative AI, Research Ethics, and Higher Education Research: Insights from a Scientometric Analysis

“…This study reflects concerns about the ability of AI to accurately assess and enhance learning without undermining the educational experience. Similarly, Mahapatra explores the impact of ChatGPT on ESL students' academic writing skills, finding that students perceive the tool as beneficial for providing formative feedback [63]. These studies suggest that AI can be an asset in education when used as a complement to traditional learning methods.…”

“…Supports-Promotes a balanced approach to AI use, combining it with human insights. 17 [63] To assess the impact of ChatGPT on English as Second Language (ESL) students' academic writing skills.…”

ChatGPT Convincingly Explains Organic Chemistry Reaction Mechanisms Slightly Inaccurately with High Levels of Explanation Sophistication

“…This raises academic integrity concerns for many educators. − However, some educators posit that GAI-based chatbots may be beneficial to help students develop programming skills, enhance critical thinking skills, , and improve conceptual understanding of chemical concepts . Alasadi and Baiz believe that GAI technologies can help create personalized learning experiences through adaptive learning, provide real-time feedback and assessment, and aid English-as-an-additional language learners in overcoming language barriers. − Emenike and Emenike hypothesize that these technologies can also benefit instructors in their teaching (e.g., creating assessment items and scoring rubrics), research (e.g., as a tool to create summaries of text-based data), and professional activities (e.g., generate text for job application statements and letters of recommendation) …”