Exploratory Multimodal Data Analysis with Standard Multimedia Player - Multimedia Containers: A Feasible Solution to Make Multimodal Research Data Accessible to the Broad Audience

Schöning, Julius; Gert, Anna L.; Açık, Alper; Kietzmann, Tim C.; Heidemann, Gunther; König, Peter

doi:10.5220/0006260202720279

Cited by 5 publications

(4 citation statements)

References 0 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Different types of auditory display can be selected, e.g. audio languages (Schöning, Gert, et al, 2017), shown in Figure 2(b). The nature of the general subtitle system in VLC only allows for one active subtitle track at all times, which unfortunately limits the range of possibilities for VA tasks significantly.…”

Section: Va Using Standard Multimedia Playersmentioning

confidence: 99%

“…By extending these initial user interviews, we performed a software user study with nine subjects. The focus of this study is to i) reevaluate the initial findings gained by the interviews (Schöning, Gert, et al, 2017), ii) evaluate our first two custom add-ons as to whether and in what manner will they be used for performing a task and iii) collect feedback on which features are missing, which use cases are not considered, and criticisms affecting the usages.…”

Section: User Studymentioning

confidence: 99%

“…We demonstrated the applicability of downloading, instantaneous visualizing of gaze data, and demuxing the multimedia container for getting the stimulus video, audio as well as the raw gaze data, on the fourth video sequence of Coutrot and Guyader (2014) showing a moving bell. In addition to gaze data and to make the participants think outside the box, the sonification of EEG data (Schöning, Gert, et al, 2017) was also illustrated. Based on this introduction, the participants rated on a Likert scale, in the questionnaires' second section, how different target groups, here unskilled users, domain experts and experts from other domains, might benefit Journal of Eye Movement Research 10(5):4, 1-14 Visual Analytics of Gaze Data with Standard Multimedia Player from providing metadata in multimedia containers.…”

Section: User Studymentioning

confidence: 99%

“…Initial findings indicate that the proposed multimedia containers are suitable for explorative multimodal data analyses with standard multimedia players. Thus, experts, as well as non-experts, can now easily access the data ( 21 ). Both user groups underline that the beauty of our approach is, to get a first expression of the whole data set with standard software.…”

Section: Benefit Of Gaze Data In Multimedia Containersmentioning

confidence: 99%

See 3 more Smart Citations

Visual Analytics of Gaze Data with Standard Multimedia Player

Schöning

Gundler

Heidemann

et al. 2017

JEMR

Self Cite

View full text Add to dashboard Cite

With the increasing number of studies, where participants’ eye movements are tracked while watching videos, the volume of gaze data records is growing tremendously. Unfortunately, in most cases, such data are collected in separate files in custom-made or proprietary data formats. These data are difficult to access even for experts and effectively inaccessible for non-experts. Normally expensive or custom-made software is necessary for their analysis. We address this problem by using existing multimedia container formats for distributing and archiving eye-tracking and gaze data bundled with the stimuli data. We define an exchange format that can be interpreted by standard multimedia players and can be streamed via the Internet. We convert several gaze data sets into our format, demonstrating the feasibility of our approach and allowing to visualize these data with standard multimedia players. We also introduce two VLC player add-ons, allowing for further visual analytics. We discuss the benefit of gaze data in a multimedia container and explain possible visual analytics approaches based on our implementations, converted datasets, and first user interviews.

show abstract

Section: Va Using Standard Multimedia Playersmentioning

confidence: 99%

Section: User Studymentioning

confidence: 99%