Measuring musical engagement using expressive movement and EEG brain dynamics.

Abstract

We have developed a method for studying musical engagement using simple expressive rhythmic "conducting" gestures matching the musical pulse. Expert and nonexpert participants attempted to communicate the feeling of heard musical excerpts using simple rhythmic U-shaped hand/arm "conducting" gestures that animated, in real time, the movement of a spot of light on a video display, while body motion capture and high-density electroencephalography (EEG) recorded their hand/arm movements and brain activity. The animations were intended to focus and simplify the conductors' hand movements. A Web-based pool of viewers then rated the recorded moving-spot animations using a musical affect rating scale. Affective ratings of the musical excerpts by conductor and viewer groups were correlated. Statistically significant differences were found in both the motion capture and the EEG data between the fully "engaged" condition described earlier and a "less musically engaged" condition in which conductors concurrently performed a mental dual distractor task. A theta/alpha-band EEG power increase in or near the right parietal-temporal-occipital junction before onsets of left-to-right swings appeared only in the fully engaged condition. Our results support: (1) Musical feeling and engagement can be communicated by rhythmic musical gestures alone, even after their reduction to a simple point-light display. (2) EEG brain activity in or near the right parietal-temporal-occipital junction appears to support affective gestural communication. (3) Expressive rhythmic gesturing does not seem to interfere with musical engagement, a possible advantage over other methods used to measure emotional engagement during music listening.

Characterization of Industry 4.0 Lean Management Problem-Solving Behavioral Patterns Using EEG Sensors and Deep Learning

“…This is the main motivation of this paper. To date there have been several systematical studies on the relationship of brain activity to high-level complex cognitive tasks [27,28] and our aim is to deepen this body of knowledge.…”

Toward physiological indices of emotional state driving future ebook interactivity

“…This transition will come with several challenges ranging from coping with external noise due to movement artifacts, multitasking users, and usability aspects such as prolonged usage (Van Erp, Lotte & Tangermann, 2012;Van Erp et al, 2013;Van Erp et al, 2011). First steps in this transition have recently been made in studies investigating EEG signals in gaming (Reuderink, Mühl & Poel, 2013) and into music perception in realistically moving participants (Leslie, Ojeda & Makeig, 2014). Here we also present the case of the writer wearing physiological sensors for several hours a day and for 9 days in a row.…”

MoBILAB: an open source toolbox for analysis and visualization of mobile brain/body imaging data

“…Pressing play will animate the stick figure and scalp map displays to match the advancing CM. Data from (Leslie et al, in press ).…”

“…Combining data modalities as different as motion capture, eye tracking, sound and video recordings, etc., with high-density EEG data allows study of brain dynamics under conditions much closer to everyday life. To date the MoBI paradigm has been applied in studies of brain dynamics supporting gait, balance, and cognition during walking (reviewed in Gramann et al, 2011 ; Sipp et al, 2013 ) and to study expressive gesturing (Leslie et al, in press ).…”