ChatGPT Is Powerful, but Does It Have Power Distance?

Abstract

Power distance (PD), a cultural value denoting acceptance of asymmetrical power relationships, influences the force of rhetoric used by a writer to address their reader. However, AI technologies such as ChatGPT lack an explicit awareness of PD, which could affect the quality of AI-generated persuasive texts used for language learning. To investigate this issue, 200 persuasive essays written by ChatGPT were compared to 200 essays written by L1-English university learners. Three elements of formulaic language related to PD were examined: stances, modals, and pronoun deixis. Differences in stances (z = -3.411; p = .001) and modals (z = -2.100; p = .036) were both significant according to the Wilcoxon signed ranks formula, whereas differences in pronoun deixis were nearly significant (z = -1.917; p = .055). Overall, language of ChatGPT appears generic and incomplete, suggesting that consistent and uniform expressions are being borrowed from an LLM training corpus to mimic aspects of PD. Limitations of AI highlight a need for pedagogical emphasis of culturally imbued discourse.