"I Can Feel Your Empathic Voice": Effects of Nonverbal Vocal Cues in Voice User Interface

Kim, Jieun; Kim, Woochan; Nam, Jungwoo; Song, Hayeon

doi:10.1145/3334480.3383075

Cited by 23 publications

(9 citation statements)

References 26 publications

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“…Owing to its empathetical conversational style, our findings showed that MICA can be seen as a human-like agent. Aligned with previous research on people's perception of CAs [91][92][93], empathetic responses from a CA would make it appear more like a human, thus helping to alleviate the social isolation of a parent as a proxy to some extent. Parents may call a CA by the name or a human pronoun (eg, "her") to keep them accountable and feel empathy and support from it.…”

Section: On Customizing Interactions Of Mi-based Cas For Parents As P...mentioning

confidence: 60%

Motivational Interviewing Conversational Agent for Parents as Proxies for Their Children in Healthy Eating: Development and User Testing

Smriti¹,

Kao²,

Rathod³

et al. 2022

JMIR Hum Factors

View full text Add to dashboard Cite

Background Increased adoption of off-the-shelf conversational agents (CAs) brings opportunities to integrate therapeutic interventions. Motivational Interviewing (MI) can then be integrated with CAs for cost-effective access to it. MI can be especially beneficial for parents who often have low motivation because of limited time and resources to eat healthy together with their children. Objective We developed a Motivational Interviewing Conversational Agent (MICA) to improve healthy eating in parents who serve as a proxy for health behavior change in their children. Proxy relationships involve a person serving as a catalyst for behavior change in another person. Parents, serving as proxies, can bring about behavior change in their children. Methods We conducted user test sessions of the MICA prototype to understand the perceived acceptability and usefulness of the MICA prototype by parents. A total of 24 parents of young children participated in 2 user test sessions with MICA, approximately 2 weeks apart. After parents’ interaction with the MICA prototype in each user test session, we used qualitative interviews to understand parents’ perceptions and suggestions for improvements in MICA. Results Findings showed participants’ perceived usefulness of MICAs for helping them self-reflect and motivating them to adopt healthier eating habits together with their children. Participants further suggested various ways in which MICA can help them safely manage their children’s eating behaviors and provide customized support for their proxy needs and goals. Conclusions We have discussed how the user experience of CAs can be improved to uniquely offer support to parents who serve as proxies in changing the behavior of their children. We have concluded with implications for a larger context of designing MI-based CAs for supporting proxy relationships for health behavior change.

show abstract

Section: On Customizing Interactions Of Mi-based Cas For Parents As P...mentioning

confidence: 60%

Motivational Interviewing Conversational Agent for Parents as Proxies for Their Children in Healthy Eating: Development and User Testing

Smriti¹,

Kao²,

Rathod³

et al. 2022

JMIR Hum Factors

View full text Add to dashboard Cite

show abstract

“…By analyzing the data from their voice interaction experiments, they asserted that humans complain that a synthesizer sounds ''robotic'' or ''alien'' because the voice signal is expressing the wrong emotion, leading to confusion and miscommunication. Kim et al [14] investigated the effect of nonverbal vocal cues in speech interaction on the user's perception of the agent. They designed the experiment to analyze participants' responses regarding intimacy, similarity, connectedness, enjoyment, and ease of use of the speech interaction agent.…”

Section: A Emotion In User Voice Interactionmentioning

confidence: 99%

Waiting Experience: Optimization of Feedback Mechanism of Voice User Interfaces Based on Time Perception

Wang

Yang

et al. 2023

IEEE Access

View full text Add to dashboard Cite

Waiting is an indispensable and inevitable part of man-machine voice interaction. The voice user interface (VUI) feedback mechanism is a key factor affecting voice interaction's waiting experience. The feedback time of most available voice interfaces is fixed or decided by the processing time of hardware and software, which has not been designed and cannot offer users a good interaction experience. In this paper, the speech rate of user-machine voice interaction is collected through prototype experimentation. Besides, users' time perception of different voice interfaces' feedback time settings is studied based on time psychology theories. Moreover, users' emotional changes are described after a specific feedback time with the distribution of two-dimension arousal-valence emotion space. Users' time perception and subjective emotions are differently influenced by different VUI feedback times. The experimental results show that 750 ms is the optimal VUI feedback time point at which the best users' subjective feelings and psychological experiences are reached, and the threshold limit time spent by users in waiting for the VUI feedback is 1,850 ms which will lead to user emotions with low levels of arousal and valence after being exceeded. Based on that, a linear regression model is proposed to define the optimal feedback time of VUI. The user experience VUI research results show that the calculated feedback time parameters can make users produce time perception in line with their expectations in interacting with voice interfaces.INDEX TERMS Voice user interface, feedback time, time perception, speech rate.

show abstract

“…From this point of view, designing agents should respond to the behavioral tendencies of humans on behalf of users' adjustments of behaviors [6]. Previous studies have shown efective strategies that enable agents to socially interact with the rules in human society by imbuing agents with human qualities such as intelligence, empathy [14,33], and politeness [27]. Designing such human-like agents could encourage users to anthropomorphize nonhuman agents, which may increase social connection between the user and the agent [19,56].…”

Section: Related Work 21 Human-likeness In Human-agent Interactionmentioning

confidence: 99%

Understanding the Negative Aspects of User Experience in Human-likeness of Voice-based Conversational Agents

Kim

Jung

Lim

2022

Designing Interactive Systems Conference

View full text Add to dashboard Cite

With advances in artifcial intelligence technology, Voice-based Conversational Agents (VCAs) can now imitate human abilities, sometimes almost indistinguishably from humans. However, concerns have been raised that too much perceived similarity can trigger threats and fears among users. This raises a question: Should VCAs be able to imitate humans perfectly? To address this, we explored what infuences the negative aspects of user experience in humanlike VCAs. We conducted a qualitative exploratory study to elicit participants' perceptions and feelings of human-like VCAs through comparable video prototypes of human-agent conversation and human-human conversation. We discovered that the dialogues of the human-likeness outside of the expressed purpose of a VCA and expressions pretending to come from a human identity could lead to negative experiences with VCAs. Based on our fndings, we discussed design directions for overcoming potential issues of human imitation. CCS CONCEPTS• Human-centered computing → Empirical studies in interaction design.

show abstract

"I Can Feel Your Empathic Voice": Effects of Nonverbal Vocal Cues in Voice User Interface

Cited by 23 publications

References 26 publications

Motivational Interviewing Conversational Agent for Parents as Proxies for Their Children in Healthy Eating: Development and User Testing

Motivational Interviewing Conversational Agent for Parents as Proxies for Their Children in Healthy Eating: Development and User Testing

Waiting Experience: Optimization of Feedback Mechanism of Voice User Interfaces Based on Time Perception

Understanding the Negative Aspects of User Experience in Human-likeness of Voice-based Conversational Agents

Contact Info

Product

Resources

About