ElectroEncephaloGraphics: Making Waves in Computer Graphics Research

Abstract

We present the application of ElectroEncephaloGraphy (EEG) as a novel modality for investigating perceptual graphics problems. Until recently, EEG has predominantly been used for clinical diagnosis, in psychology and by the BCI community. Here we want to extend its scope to assist in understanding the perception of visual output from graphics applications and to create new approaches based on direct neural feedback. We begin by introducing the fundamentals of EEG measurements, its neurophysiological basis and the limitations of EEG in determining certain aspects of visual perception. We then present three different areas for EEG application in graphics: determining perceived image and video quality through the detection of typical rendering artifacts, evaluating visualization effectiveness by calculating cognitive load from EEG data, and automatic optimization of rendering parameters for images and videos based on implicit neural feedback. We conclude with an outlook on what the future of EEG in graphics may hold.