Affective processing in natural scene viewing: Valence and arousal interactions in eye-fixation-related potentials

Simola, Jaana; Fevre, Kevin Le; Torniainen, Jari; Baccino, Thierry

doi:10.1016/j.neuroimage.2014.11.030

Cited by 77 publications

(70 citation statements)

References 48 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Most co-registration studies of free viewing behavior use either a mastoid reference (Devillez et al, 2015;Fischer et al, 2013;Graupner et al, 2007;Körner et al, 2014;Ossandón et al, 2010;Rama & Baccino, 2010;Simola et al, 2015) or an average reference Dimigen et al, 2009;Kamienkowski et al, 2012). We used a mastoid reference in the analysis of CB dataset because the limited number of electrodes did not allow us to convert the data to average reference reliably (Dien, 1998) and an average reference in the analysis of VS dataset, which was recorded from 256 electrodes.…”

Section: Eeg Recordingmentioning

confidence: 99%

“…Being close to the to-be-corrected epochs (typically within several hundred ms), this baseline provides the most accurate correction and is most commonly used in co-registration research. The individual baseline is typically set before saccade onset (Fischer et al, 2013;Fudali-Czyz et al, 2014;Kamienkowski et al, 2012;Kaunitz et al, 2014;Nikolaev et al, 2013) or briefly (e.g., 0-20 ms) after fixation onset (Rama & Baccino, 2010;Simola et al, 2015). In the latter case, it is supposed that the baseline is free of EEG artifacts related to eye movement execution, whereas activity related to visual processing (e.g., the lambda activity) has not started yet.…”

Section: Selection Of a Baseline Intervalmentioning

confidence: 99%

“…Next, we estimated the effect of preceding fixation duration on the EEG, using a baseline interval 0-20 ms after the fixation onset, similarly to Rama and Baccino (2010) and Simola et al (2015). In this analysis, EEG was time-locked to fixation onset and the preceding fixation could be of any duration, whereas the subsequent fixation was longer than 300 ms (Table 1).…”

Section: Effect Of Preceding Fixation Durationmentioning

confidence: 99%

“…In particular, co-registration is increasingly becoming popular in conditions involving continued exploration, i.e., free viewing. 1 Because it can be used in naturalistic conditions, co-registration provides an exciting new paradigm for studying attention (Fischer, Graupner, Velichkovsky, & Pannasch, 2013), memory encoding (Nikolaev, Jurica, Nakatani, Plomp, & van Leeuwen, 2013;Nikolaev, Nakatani, Plomp, Jurica, & van Leeuwen, 2011), visual search (Dias, Sajda, Dmochowski, & Parra, 2013;Kamienkowski, Ison, Quiroga, & Sigman, 2012;Kaunitz et al, 2014;Körner et al, 2014), reading (Dimigen, Sommer, Hohlfeld, Jacobs, & Kliegl, 2011;Hutzler et al, 2007), and responses to emotionally charged visual information (Simola, Le Fevre, Torniainen, & Baccino, 2015;Simola, Torniainen, Moisala, Kivikangas, & Krause, 2013), just to mention some domains http://dx.doi.org/10.1016/j.bandc.2016.06.004 0278-2626/Ó 2016 Elsevier Inc. All rights reserved. of basic research in which this technique is successfully being used.…”

Section: Introductionmentioning

confidence: 99%

See 3 more Smart Citations

Combining EEG and eye movement recording in free viewing: Pitfalls and possibilities

Nikolaev

Meghanathan

Leeuwen

2016

Brain and Cognition

106

151

View full text Add to dashboard Cite

Co-registration of EEG and eye movement has promise for investigating perceptual processes in free viewing conditions, provided certain methodological challenges can be addressed. Most of these arise from the self-paced character of eye movements in free viewing conditions. Successive eye movements occur within short time intervals. Their evoked activity is likely to distort the EEG signal during fixation. Due to the non-uniform distribution of fixation durations, these distortions are systematic, survive across-trials averaging, and can become a source of confounding. We illustrate this problem with effects of sequential eye movements on the evoked potentials and time-frequency components of EEG and propose a solution based on matching of eye movement characteristics between experimental conditions. The proposal leads to a discussion of which eye movement characteristics are to be matched, depending on the EEG activity of interest. We also compare segmentation of EEG into saccade-related epochs relative to saccade and fixation onsets and discuss the problem of baseline selection and its solution. Further recommendations are given for implementing EEG-eye movement co-registration in free viewing conditions. By resolving some of the methodological problems involved, we aim to facilitate the transition from the traditional stimulus-response paradigm to the study of visual perception in more naturalistic conditions.

show abstract

Section: Eeg Recordingmentioning

confidence: 99%

Section: Selection Of a Baseline Intervalmentioning

confidence: 99%

Section: Effect Of Preceding Fixation Durationmentioning

confidence: 99%

Section: Introductionmentioning

confidence: 99%

See 2 more Smart Citations

Combining EEG and eye movement recording in free viewing: Pitfalls and possibilities

Nikolaev

Meghanathan

Leeuwen

2016

Brain and Cognition

106

151

View full text Add to dashboard Cite

show abstract

“…Affective salience maps are made by having subjects click on the most emotionally engaging parts of an image. A description of how to create manual affective salience maps can be found in [61]. However, in a real HCI context, where many low-level and high-level factors are present at the same time, the interpretation of gaze heatmaps is more problematic.…”

Section: Emotional Saliencementioning

confidence: 99%

Physiological heatmaps: a tool for visualizing users’ emotional reactions

Courtemanche

Léger

Dufresne

et al. 2017

Multimed Tools Appl

View full text Add to dashboard Cite

Practitioners in many fields of human-computer interaction are now using physiological data to measure different aspects of user experience. The dynamic nature of physiological data offers a continuous window to the users and allows a better understanding of their experience while interacting with a system. However, in order to be truly informative, physiological signals need to be closely linked to users' behaviors and interaction states. This paper presents an analysis method that provides a direct visual interpretation of users' physiological signals when interacting with an interface. The proposed physiological heatmap tool uses eyetracking data along with physiological signals to identify regions where users are experiencing different emotional and cognitive states with a higher frequency. The method was evaluated in an experiment with 44 participants. Results show that physiological heatmaps are able to identify emotionally significant regions within an interface better than standard gaze heatmaps. Applications of the method to different fields of HCI research are also discussed.

show abstract

Emotion and Memory

Kensinger

Kark

2018

Stevens' Handbook of Experimental Psychology and Cognitive Neuroscience

View full text Add to dashboard Cite

People are more likely to remember emotional events as compared to mundane events. Not all aspects of those events are retained, however, and the effects of emotion on memory can vary as a function of the type of emotion evoked by the event and the time course over which memory is tested. In this chapter, we first describe how the arousal and valence of an event can influence the way it is remembered. We discuss how arousal can lead to selective enhancements in memory and how these enhancements can occur relatively automatically. We describe how negative events can be remembered with greater detail and specificity than positive events, and we delineate possible neural mechanisms that may support these effects of valence and arousal. We then discuss the time course over which emotion exerts its effects on memory. We describe how arousal exerts very rapid effects on encoding processes, faster than those elicited by valence. We discuss how emotion modulates the memory search process, increasing the likelihood that past events are retrieved. We explain how emotional arousal can influence the consolidation of information. We conclude by pointing out ongoing debates, including the role of the amygdala in the consolidation process and the effect of emotion on memory accuracy.

show abstract

Affective processing in natural scene viewing: Valence and arousal interactions in eye-fixation-related potentials

Cited by 77 publications

References 48 publications

Combining EEG and eye movement recording in free viewing: Pitfalls and possibilities

Combining EEG and eye movement recording in free viewing: Pitfalls and possibilities

Physiological heatmaps: a tool for visualizing users’ emotional reactions

Emotion and Memory

Contact Info

Product

Resources

About