A dynamic goal adapted task oriented dialogue agent

Abstract

Purpose Existing virtual agents (VAs) present in dialogue systems are either information retrieval based or static goal-driven. However, in real-world situations, end-users might not have a known and fixed goal beforehand for the task, i.e., they may upgrade/downgrade/update their goal components in real-time to maximize their utility values. Existing VAs are unable to handle such dynamic goal-oriented situations. Methodology Due to the absence of any related dialogue dataset where such choice deviations are present, we have created a conversational dataset called Deviation adapted Virtual Agent(DevVA), with the manual annotation of its corresponding intents, slots, and sentiment labels. A Dynamic Goal Driven Dialogue Agent (DGDVA) has been developed by incorporating a Dynamic Goal Driven Module (GDM) on top of a deep reinforcement learning based dialogue manager. In the course of a conversation, the user sentiment provides grounded feedback about agent behavior, including goal serving action. User sentiment appears to be an appropriate indicator for goal discrepancy that guides the agent to complete the user’s desired task with gratification. The negative sentiment expressed by the user about an aspect of the provided choice is treated as a discrepancy that is being resolved by the GDM depending upon the observed discrepancy and current dialogue state. The goal update capability and the VA’s interactiveness trait enable end-users to accomplish their desired task satisfactorily. Findings The obtained experimental results illustrate that DGDVA can handle dynamic goals with maximum user satisfaction and a significantly higher success rate. The interaction drives the user to decide its final goal through the latent specification of possible choices and information retrieved and provided by the dialogue agent. Through the experimental results (qualitative and quantitative), we firmly conclude that the proposed sentiment-aware VA adapts users’ dynamic behavior for its goal setting with substantial efficacy in terms of primary objective i.e., task success rate (0.88). Practical implications In real world, it can be argued that many people do not have a predefined and fixed goal for tasks such as online shopping, movie booking & restaurant booking, etc. They tend to explore the available options first which are aligned with their minimum requirements and then decide one amongst them. The DGDVA provides maximum user satisfaction as it enables them to accomplish a dynamic goal that leads to additional utilities along with the essential ones. Originality To the best of our knowledge, this is the first effort towards the development of A Dynamic Goal Adapted Task-Oriented Dialogue Agent that can serve user goals dynamically until the user is satisfied.

Reinforcing personalized persuasion in task-oriented virtual sales assistant

“…Then recently, the research [ 28 ] proposes a personalized end-to-end task-oriented conversation system that uses a memory network to create attractive and persona-consistent replies. In other recent publications [ 29 – 32 ], the researchers emphasized the DST module to carry out persuasion in task-oriented conversation agents to catch and address dynamic user needs effectively.…”

Framework for Deep Learning-Based Language Models Using Multi-Task Learning in Natural Language Understanding: A Systematic Literature Review and Future Directions

“…• VIRAAL-The study [109] • Sub-modularity-inspired data ranking function -The study [110] tries to address the problems for small domains, which requires a huge amount of domain-related training data. The data selection technique is proposed in a low-data regime that enables with fewer labelled data.…”

Recommendations for designing conversational companion robots with older adults through foundation models

“…Prior research initially focused on BERT ( Devlin et al, 2019 ) for dialogue state tracking, intent classification, and response generation (e.g., Dong et al, 2019 ; Tiwari et al, 2021 ) primarily in task-oriented dialogue, which is designed for a specific goal, such as restaurant booking. Recently, LLMs (e.g., GPT-3 ( Brown et al, 2020 ), LLaMA ( Touvron et al, 2023 ), Falcon ( Penedo et al, 2023 ), Pythia ( Biderman et al, 2023 ), Mistral ( Jiang et al, 2023 )) that are trained on vast amounts of textual data, showed promise for generating coherent text and speech by using prompts for inferring the context, thereby, enabling open-domain dialogue with unrestricted topics ( Huang et al, 2020 ).…”