Estimation of User's Internal State before the User's First Utterance Using Acoustic Features and Face Orientation

Chiba, Yuya; Ito, Masashi; Ito, Akinori

doi:10.1109/hsi.2012.13

Search citation statements

Order By: Relevance

Paper Sections

Select...

Introduction1

Citation Types

Supporting

Mentioning

Contrasting

Year Published

2013

Publication Types

Select...

Book1

Relationship

Self Cite1

Independent0

Authors

Journals

Cited by 1 publication

(1 citation statement)

References 21 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Since the discrimination must be processed before the user's input, we denote them as the user's internal state "during a dialog turn." In our previous study [5], we made an attempt to distinguish these three states using an SVM and the features extracted from the whole video sequences. It worked well, but we cannot use the whole sequence as an input for the purpose to help the user who has difficulty to make an utterance.…”

Section: Introductionmentioning

confidence: 99%

Estimation of User’s State during a Dialog Turn with Sequential Multi-modal Features

Chiba

Ito

2013

Communications in Computer and Information Science

Self Cite

View full text Add to dashboard Cite

Spoken dialog system (SDS) is a typical speech application and sometimes regarded as one of ideal interfaces. However, most of conventional SDSs cannot help their user while waiting for input utterance since they treat a user's utterance as a trigger of processing. This architecture is largely different from the manner of human-human interaction and factor that makes the user feel inconvenience when they cannot respond to the system's prompt appropriately. To solve this problem, the system should be able to estimate the internal state of the user before observing the user's input utterance. In present paper, we proposed twostep discrimination method using multi-modal information to estimate the user's state frame by frame.

show abstract

Section: Introductionmentioning

confidence: 99%