Conversational AI (e.g., Google Assistant or Amazon Alexa) is present in many people’s everyday life and, at the same time, becomes more and more capable of solving more complex tasks. However, it is unclear how the growing capabilities of conversational AI affect people’s disclosure towards the system as previous research has revealed mixed effects of technology competence. To address this research question, we propose a framework systematically disentangling conversational AI competencies along the lines of the dimensions of human competencies suggested by the action regulation theory. Across two correlational studies and three experiments ( Ntotal = 1453), we investigated how these competencies differentially affect users’ and non-users’ disclosure towards conversational AI. Results indicate that intellectual competencies (e.g., planning actions and anticipating problems) in a conversational AI heighten users’ willingness to disclose and reduce their privacy concerns. In contrast, meta-cognitive heuristics (e.g., deriving universal strategies based on previous interactions) raise privacy concerns for users and, even more so, for non-users but reduce willingness to disclose only for non-users. Thus, the present research suggests that not all competencies of a conversational AI are seen as merely positive, and the proposed differentiation of competencies is informative to explain effects on disclosure.
Conversational AI, like Amazon’s Alexa, are often marketed as tools assisting owners, but humans anthropomorphize computers, suggesting that they bond with their devices beyond an owner-tool relationship. Little empirical research has studied human-AI relationships besides relational proxies such as trust. We explored the relationships people form with conversational AI based on the Relational Models Theory (RMT, Fiske, 1992). Results of the factor analyses among frequent users (Ntotal = 729) suggest that they perceive the relationship more as a master-assistant relationship (i.e., authority ranking) and an exchange relationship (i.e., market pricing) than as a companion-like relationship (i.e., peer bonding). The correlational analysis showed that authority ranking barely correlates with system perception or user characteristics, whereas market pricing and peer bonding do. The relationship perception proved to be independent of demographic factors and label of the digital device. Our research enriches the traditional dichotomous approach. The extent to which users see their conversational AI as exchange partners or peer-like has a stronger predictive value regarding human-like system perception of conversational AI than the perception of it as servants.
Communication scholars are increasingly concerned with interactions between humans and communicative agents. These agents, however, are considerably different from digital or social media: They are designed and perceived as life-like communication partners (i.e., as “communicative subjects”), which in turn poses distinct challenges for their empirical study. Hence, in this paper, we document, discuss, and evaluate potentials and pitfalls that typically arise for communication scholars when investigating simulated or non-simulated interactions between humans and chatbots, voice assistants, or social robots. In this paper, we focus on experiments (including pre-recorded stimuli, vignettes and the “Wizard of Oz”-technique) and field studies. Overall, this paper aims to provide guidance and support for communication scholars who want to empirically study human-machine communication. To this end, we not only compile potential challenges, but also recommend specific strategies and approaches. In addition, our reflections on current methodological challenges serve as a starting point for discussions in communication science on how meaning-making between humans and machines can be investigated in the best way possible, as illustrated in the concluding section.
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.