EmoEcho

Woodward, Kieran; Kanjo, Eiman; Burton, Samuel; Οικονόμου, Ανδρέας

doi:10.1145/3267305.3267705

Cited by 18 publications

(1 citation statement)

References 13 publications

(13 reference statements)

Supporting

Mentioning

Contrasting

Order By: Relevance

“…When affect classification using such data become possible, this technology may be applied in several user interfaces designed for entertainment, well-being and motor rehabilitation. It can be a communication device for people with reduced verbal communication abilities [26], a general purpose affect sensor e.g., for self-monitoring [11,22] and remote communication [31], a game interface. It can also be embedded in "smart" versions of several every day objects to sense the user's emotions.…”

Section: Introductionmentioning

confidence: 99%

Multimodal Emotion Recognition of Hand-Object Interaction

Niewiadomski

Sciutti

2021

26th International Conference on Intelligent User Interfaces

View full text Add to dashboard Cite

In this paper, we investigate whether information related to touches and rotations impressed to an object can be effectively used to classify the emotion of the agent manipulating it. We specifically focus on sequences of basic actions (e.g., grasping, rotating), which are constituents of daily interactions. We use the iCube, a 5 cm cube covered with tactile sensors and embedded with an accelometer, to collect a new dataset including 11 persons performing action sequences associated with 4 emotions: anger, sadness, excitement and gratitude. Next, we propose 17 high-level hand-crafted features based on the tactile and kinematics data derived from the iCube. Twelve of these features vary significantly as a function of the emotional context in which the action sequence was performed. In particular, a larger surface of the object is engaged in physical contact for anger and excitement, than for sadness. Furthermore, the average duration of interactions labeled as sad, is longer than for the remaining 3 emotions. More rotations are performed for anger and excitement than for sadness and gratitude. The accuracy of a classification experiment in the case of four emotions reaches 0.75. This result shows that the emotion recognition during handobject interactions is possible and it may foster development of new intelligent user interfaces. CCS CONCEPTS• Human-centered computing → Human computer interaction (HCI); Interaction devices.

show abstract