Toward physiological indices of emotional state driving future ebook interactivity

Erp, J.B.F. van; Hogervorst, Maarten A.; Werf, Ysbrand D. van der

doi:10.7717/peerj-cs.60

Cited by 4 publications

(4 citation statements)

References 81 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…For this reason, cartoons could be a good pilot test before starting large-scale content making business. From a new media perspective, neurophysiological measures could be used to enhance the viewing experience in accordance with personal preferences ( Johannisson, 2016 ; Maskeliunas & Raudonis, 2016 ) and adjust the customized story plot in making interactive E-books ( Li et al, 2016 ; Maskeliunas et al, 2016 ; Van Erp, Hogervorst & Van der Werf, 2016 ).…”

Section: Discussionmentioning

confidence: 99%

Character drawing style in cartoons on empathy induction: an eye-tracking and EEG study

Yong-IL

Choi

Jeong

2017

PeerJ

View full text Add to dashboard Cite

In its most basic form, empathy refers to the ability to understand another person’s feelings and emotions, representing an essential component of human social interaction. Owing to an increase in the use of mass media, which is used to distribute high levels of empathy-inducing content, media plays a key role in individual and social empathy induction. We investigated empathy induction in cartoons using eye movement, EEG and behavioral measures to explore whether empathy factors correlate with character drawing styles. Two different types of empathy-inducing cartoons that consisted of three stages and had the same story plot were used. One had an iconic style, while the other was realistic style. Fifty participants were divided into two groups corresponding to the individual cartoon drawing styles and were presented with only one type of drawing style. We found that there were no significant differences of empathy factors between iconic and realistic style. However, the Induced Empathy Score (IES) had a close relationship with subsequent attentional processing (total fixation length for gaze duration). Furthermore, iconic style suppressed the fronto-central area more than realistic style in the gamma power band. These results suggest that iconic cartoons have the advantage of abstraction during empathy induction, because the iconic cartoons induced the same level of empathy as realistic cartoons while using the same story plot (top-down process), even though lesser time and effort were required by the cartoon artist to draw them. This also means that the top-down process (story plot) is more important than the bottom-up process (drawing style) in empathy induction when viewing cartoons

show abstract

Section: Discussionmentioning

confidence: 99%

Character drawing style in cartoons on empathy induction: an eye-tracking and EEG study

Yong-IL

Choi

Jeong

2017

PeerJ

View full text Add to dashboard Cite

show abstract

“…For passive BCIs, relying on multiple users can produce more robust neuro-ergonomic evaluations [207]. Jan van Erp reported on experiments with 20 coupled brains in artistic expression, with topics ranging from measuring collective emotional experience in reading [208,209] to real-time alterations of electronic dance music. He also explained the potential of hyperscanning techniques in understanding group dynamics and bullying behavior in the classroom.…”

Section: Collaborative and Competing Multi-brain Bci'smentioning

confidence: 99%

Workshops of the seventh international brain-computer interface meeting: not getting lost in translation

Huggins

Guger

Aarnoutse

et al. 2019

Brain-Computer Interfaces

View full text Add to dashboard Cite

The interactive nature of this conference was embodied by 25 workshops covering topics in BCI (also called brain-machine interface) research. Workshops covered foundational topics such as hardware development and signal analysis algorithms, new and imaginative topics such as BCI for virtual reality and multi-brain BCIs, and translational topics such as clinical applications and ethical assumptions of BCI development. BCI research is expanding in the diversity of applications and populations for whom those applications are being developed. BCI applications are moving toward clinical readiness as researchers struggle with the practical considerations to make sure that BCI translational efforts will be successful. This paper summarizes each workshop, providing an overview of the topic of discussion, references for additional information, and identifying future issues for research and development that resulted from the interactions and discussion at the workshop.

show abstract

“…Generally, a drop in heart rate or an increase in HRV can occur at the beginning of a drowsiness state [2], [14]. It is important to notice that both indices are influenced by a variety of factors, including physical movement, mental activity, and emotional state [16]. Finally, and far less explored, body temperature is also linked to arousal as it reflects on the person's state, reflecting the autonomic responses [17].…”

Section: Related Workmentioning

confidence: 99%

Deep Physiological Arousal Detection in a Driving Simulator Using Wearable Sensors

Saeed

Trajanovski²,

Keulen

et al. 2017

2017 IEEE International Conference on Data Mining Workshops (ICDMW)

View full text Add to dashboard Cite

Driving is an activity that requires considerable alertness. Insufficient attention, imperfect perception, inadequate information processing, and sub-optimal arousal are possible causes of poor human performance. Understanding of these causes and the implementation of effective remedies is of key importance to increase traffic safety and improve driver's wellbeing. For this purpose, we used deep learning algorithms to detect arousal level, namely, under-aroused, normal and overaroused for professional truck drivers in a simulated environment. The physiological signals are collected from 11 participants by wrist wearable devices. We presented a cost effective groundtruth generation scheme for arousal based on a subjective measure of sleepiness and score of stress stimuli. On this dataset, we evaluated a range of deep neural network models for representation learning as an alternative to handcrafted feature extraction. Our results show that a 7-layers convolutional neural network trained on raw physiological signals (such as heart rate, skin conductance and skin temperature) outperforms a baseline neural network and denoising autoencoder models with weighted F-score of 0.82 vs. 0.75 and Kappa of 0.64 vs. 0.53, respectively. The proposed convolutional model not only improves the overall results but also enhances the detection rate for every driver in the dataset as determined by leave-one-subject-out cross-validation.

show abstract

Toward physiological indices of emotional state driving future ebook interactivity

Cited by 4 publications

References 81 publications

Character drawing style in cartoons on empathy induction: an eye-tracking and EEG study

Character drawing style in cartoons on empathy induction: an eye-tracking and EEG study

Workshops of the seventh international brain-computer interface meeting: not getting lost in translation

Deep Physiological Arousal Detection in a Driving Simulator Using Wearable Sensors

Contact Info

Product

Resources

About