Assessment of Eye Fatigue Caused by 3D Displays Based on Multimodal Measurements

Abstract

With the development of 3D displays, user's eye fatigue has been an important issue when viewing these displays. There have been previous studies conducted on eye fatigue related to 3D display use, however, most of these have employed a limited number of modalities for measurements, such as electroencephalograms (EEGs), biomedical signals, and eye responses. In this paper, we propose a new assessment of eye fatigue related to 3D display use based on multimodal measurements. compared to previous works Our research is novel in the following four ways: first, to enhance the accuracy of assessment of eye fatigue, we measure EEG signals, eye blinking rate (BR), facial temperature (FT), and a subjective evaluation (SE) score before and after a user watches a 3D display; second, in order to accurately measure BR in a manner that is convenient for the user, we implement a remote gaze-tracking system using a high speed (mega-pixel) camera that measures eye blinks of both eyes; thirdly, changes in the FT are measured using a remote thermal camera, which can enhance the measurement of eye fatigue, and fourth, we perform various statistical analyses to evaluate the correlation between the EEG signal, eye BR, FT, and the SE score based on the T-test, correlation matrix, and effect size. Results show that the correlation of the SE with other data (FT, BR, and EEG) is the highest, while those of the FT, BR, and EEG with other data are second, third, and fourth highest, respectively.

Effects of Viewing Displays from Different Distances on Human Visual System

“…Numerous studies have been conducted to evaluate the visual fatigue caused because of watching 3D displays using electroencephalogram (EEG) [1][2][3][4][5][6][7][8][9][10][11][12][13][14][15][16]. The EEG method is selected as it is the most significant and reliable physiological measure for evaluating mental fatigue [17][18][19][20][21].…”

“…De Waard [22], and Fisch and Spehlmann [23] classified the EEG signal into four characteristic waves based on their frequency, namely delta wave (δ, 0-4 Hz), theta wave (θ, 4-8 Hz), alpha wave (α, [8][9][10][11][12][13], and beta wave (β, 13-30 Hz). The delta (δ) wave is usually related to the depth of sleep; moreover, this wave is associated with specific encephalopathic diseases and underlying lesions [13]. The theta (θ) wave is related to drowsiness.…”

Psychophysiology-Based QoE Assessment: A Survey

“…For instance, eye movements provide valuable insight into overt visual attention in addition to covert attention captured through EEG measurements [13]. Furthermore, eye blink rate is known to relate to visual fatigue [14] and pupil dilation to cognitive load [15], both of which are relevant to QoE assessment. Of practical relevance, the eye measurement may provide insight into cognitive activity that is not easily observable through other methods.…”

“…3) Prior art: Previous studies have demonstrated an association between eye BR and visual discomfort [14]. One study examining QoE viewing on 3D displays showed opposite effects on changes in eye BR and visual discomfort based on whether presented stimuli was in-depth motion, which caused an increase in rate, or planar motion, which resulted in a decreased rate [81].…”

“…The experiences assessed with multimodal approaches are broad and range from traditional applications, such as multimedia quality assessment [32], [47], through more advanced applications, such as assessing visual fatigue for 3D video [14], [80] and tone mapping perception for high dynamic range (HDR) video [35], to higher-level experiences, including immersiveness [76] , emotion [77], stress [79], and engagement [78]. Most studies do not abandon traditional self-reporting but rather include it as a well understood reference.…”