What Does Touch Tell Us about Emotions in Touchscreen-Based Gameplay?

Gao, Yuan; Bianchi-Berthouze, Nadia; Meng, Hongying

doi:10.1145/2395131.2395138

Cited by 141 publications

(115 citation statements)

References 79 publications

Supporting

Mentioning

108

Contrasting

Unclassified

Order By: Relevance

“…Touch screens are used by an increasing number of people and offer much richer interaction parameters than keystrokes such as scrolling, tapping, or stroking. Recent work by Gao et al (2012) showed that in a particular game played on the iPod, touch inputs like stroke length, pressure, and speed were important features related to a participant's verbal description of the emotional experience during the game. Using a linear SVM, classification performance reached 77% for four emotional classes (excited, relaxed, frustrated, and bored), close to 90% for two levels of arousal, and close to 85% for two levels of valence.…”

Section: Recognizing and Interpreting Social Touch Signalsmentioning

confidence: 99%

Social Touch in Humanâ€“Computer Interaction

Erp

Toet²

2015

Front. Digit. Humanit.

143

View full text Add to dashboard Cite

Touch is our primary non-verbal communication channel for conveying intimate emotions and as such essential for our physical and emotional wellbeing. In our digital age, human social interaction is often mediated. However, even though there is increasing evidence that mediated touch affords affective communication, current communication systems (such as videoconferencing) still do not support communication through the sense of touch. As a result, mediated communication does not provide the intense affective experience of co-located communication. The need for ICT mediated or generated touch as an intuitive way of social communication is even further emphasized by the growing interest in the use of touch-enabled agents and robots for healthcare, teaching, and telepresence applications. Here, we review the important role of social touch in our daily life and the available evidence that affective touch can be mediated reliably between humans and between humans and digital agents. We base our observations on evidence from psychology, computer science, sociology, and neuroscience with focus on the first two. Our review shows that mediated affective touch can modulate physiological responses, increase trust and affection, help to establish bonds between humans and avatars or robots, and initiate pro-social behavior. We argue that ICT mediated or generated social touch can (a) intensify the perceived social presence of remote communication partners and (b) enable computer systems to more effectively convey affective information. However, this research field on the crossroads of ICT and psychology is still embryonic and we identify several topics that can help to mature the field in the following areas: establishing an overarching theoretical framework, employing better research methodologies, developing basic social touch building blocks, and solving specific ICT challenges.

show abstract

Section: Recognizing and Interpreting Social Touch Signalsmentioning

confidence: 99%

Social Touch in Humanâ€“Computer Interaction

Erp

Toet²

2015

Front. Digit. Humanit.

143

View full text Add to dashboard Cite

show abstract

“…Initial work towards building systems for the automatic detection of affective touch are summarised in Gao et al [13]. Through their study, the authors also shows that the kinematics of strokes during a touch-based computer games on smartphone allow the detection of how a player feels with very high performances.…”

Section: Introduction * Corresponding Authormentioning

confidence: 99%

Social Touch Gesture Recognition using Random Forest and Boosting on Distinct Feature Sets

Gaus

Olugbade

Jan

et al. 2015

Proceedings of the 2015 ACM on International Conference on Multimodal Interaction

Self Cite

View full text Add to dashboard Cite

Touch is a primary nonverbal communication channel used to communicate emotions or other social messages. A variety of social touch exists including hugging, rubbing and punching. Despite its importance, this channel is still very little explored in the affective computing field, as much more focus has been placed on visual and aural channels. In this paper, we investigate the possibility to automatically discriminate between different social touch types. We propose five distinct feature sets for describing touch behaviours captured by a grid of pressure sensors. These features are then combined together by using the Random Forest and Boosting methods for categorizing the touch gesture type. The proposed methods were evaluated on both the HAART (7 gesture types over different surfaces) and the CoST (14 gesture types over the same surface) datasets made available by the Social Touch Gesture Challenge 2015. Well above chance level performances were achieved with a 67% accuracy for the HAART and 59% for the CoST testing datasets respectively.

show abstract

“…This may be particularly relevant to furthering the understanding of tactile conveyance of intimate emotions such as love where adults may feel comparatively inhibited. Other properties of touch were not explored in this study, for example, speed of interaction was not evaluated but has previously found to be an important emotion-interaction factor [50]. Going beyond the original properties of touch investigated in the human-human empirical reference study is an endeavour of clear importance for understanding human-robot tactile emotional interaction possibilities.…”

mentioning

confidence: 99%

Designing for a Wearable Affective Interface for the NAO Robot: A Study of Emotion Conveyance by Touch

Lowe

Andreasson

Alenljung

et al. 2018

MTI

View full text Add to dashboard Cite

Abstract:We here present results and analysis from a study of affective tactile communication between human and humanoid robot (the NAO robot). In the present work, participants conveyed eight emotions to the NAO via touch. In this study, we sought to understand the potential for using a wearable affective (tactile) interface, or WAffI. The aims of our study were to address the following: (i) how emotions and affective states can be conveyed (encoded) to such a humanoid robot, (ii) what are the effects of dressing the NAO in the WAffI on emotion conveyance and (iii) what is the potential for decoding emotion and affective states. We found that subjects conveyed touch for longer duration and over more locations on the robot when the NAO was dressed with WAffI than when it was not. Our analysis illuminates ways by which affective valence, and separate emotions, might be decoded by a humanoid robot according to the different features of touch: intensity, duration, location, type. Finally, we discuss the types of sensors and their distribution as they may be embedded within the WAffI and that would likely benefit Human-NAO (and Human-Humanoid) interaction along the affective tactile dimension.

show abstract

What Does Touch Tell Us about Emotions in Touchscreen-Based Gameplay?

Cited by 141 publications

References 79 publications

Social Touch in Humanâ€“Computer Interaction

Social Touch in Humanâ€“Computer Interaction

Social Touch Gesture Recognition using Random Forest and Boosting on Distinct Feature Sets

Designing for a Wearable Affective Interface for the NAO Robot: A Study of Emotion Conveyance by Touch

Contact Info

Product

Resources

About