Examining Agency, Expertise, and Roles of AI Systems in AI-Mediated Communication

Abstract

AI-Mediated Communication (AI-MC) occurs when an AI system operates on behalf of an individual in communication between people. Building on literature in psychology and human-machine communication, the following three studies answered two overarching questions: 1) how do people perceive their own agency when an AI system operates on their behalf in interpersonal communication? and 2) how do people perceive the role(s) of the system under these circumstances? Through a think-aloud study, as well as an online experiment, these studies revealed that people strive to maintain their agency in AI-MC, and devise various strategies to do so. Additionally, even though AI systems can play many roles in a communication task, people view them as social actors instead of as extensions of the self, which impacts how they attribute agency and behave in human-AI interactions. Lastly, people show increased reliance on the AI system when they lack expertise, which underlies decreased feelings of agency as well as changes in collaboration dynamics. Taken together, these studies apply research on agency and human-AI interaction to the nascent study of AI-MC. The results provide insights into the effects of AI-involvement and topical expertise on people’s perceptions and behaviors, as well as how they think about the roles of AI systems.

Navigating the AI era: university communication strategies and perspectives on generative AI tools

“…Research by Mieczkowski and Hancock [2022] on the agency, expertise, and roles of AI systems in communication indicates that perceptions of AI's agency and expertise significantly affect AI-mediated interactions. Wenker [2023] investigates how AI-generated smart replies impact language and agency in the workplace, indicating changes in communication dynamics.…”

A Design Space for Intelligent and Interactive Writing Assistants

“…As new writing assistants are being introduced at an increasingly fast pace, there are growing concerns that we lack a comprehensive understanding of when and in what ways it is desirable to use these writing assistants in order to avoid potential unforeseen consequences or ethical issues [121,171]. For instance, in the academic community, there are concerns about students' use of AI during writing and homework [20,55,74,170].…”