Assessing Cognitive State with Multiple Physiological Measures: A Modular Approach

Sciarini, Lee W.; Nicholson, Denise

doi:10.1007/978-3-642-02812-0_62

Cited by 12 publications

(4 citation statements)

References 19 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Wang [32]; they stated that using multiple measures reflects a better real-world setting of the youth experiences. Sciarini and Nicholson (2009) used EEG, eye blink, respiration, cardiovascular activity and speech measures in a workload task performance [33].…”

Section: Studies With Multimodal Measuresmentioning

confidence: 99%

Opensync: An Opensource Platform for Synchronizing Multiple Measures in Neuroscience Experiments

Ghods¹,

Janfaza²,

Yamauchi³

et al. 2021

Preprint

View full text Add to dashboard Cite

Background: The human mind is multimodal. Yet most behavioral studies rely on century-old measures such as task accuracy and latency. To create a better understanding of human behavior and brain functionality, we should introduce other measures and analyze behavior from various aspects. However, it is technically complex and costly to design and implement the experiments that record multiple measures. To address this issue, a platform that allows synchronizing multiple measures from human behavior is needed. Method: This paper introduces an opensource platform named OpenSync, which can be used to synchronize multiple measures in neuroscience experiments. This platform helps to automatically integrate, synchronize and record physiological measures (e.g., electroencephalogram (EEG), galvanic skin response (GSR), eye-tracking, body motion, etc.), user input response (e.g., from mouse, keyboard, joystick, etc.), and task-related information (stimulus markers). In this paper, we explain the structure and details of OpenSync, provide two case studies in PsychoPy and Unity. Comparison with existing tools: Unlike proprietary systems (e.g., iMotions), OpenSync is free and it can be used inside any opensource experiment design software (e.g., PsychoPy, OpenSesame, Unity, etc., https://pypi.org/project/OpenSync/ and https://github.com/moeinrazavi/OpenSync_Unity). Results: Our experimental results show that the OpenSync platform is able to synchronize multiple measures with microsecond resolution.

show abstract

Section: Studies With Multimodal Measuresmentioning

confidence: 99%

Opensync: An Opensource Platform for Synchronizing Multiple Measures in Neuroscience Experiments

Ghods¹,

Janfaza²,

Yamauchi³

et al. 2021

Preprint

View full text Add to dashboard Cite

show abstract

“…Gibson et al (2014) integrated questionnaires, qualitative methods, and physiological measures including ECG, respiration, electrodermal activity (EDA) and skin temperature to study activity settings in disabled youth [21]; they stated that using multiple measures reflects a better real-world setting of the youth experiences. Sciarini and Nicholson (2009) used EEG, eye blink, respiration, cardiovascular activity and speech measures in a workload task performance [22]; as they outlined, using only one measure is not sufficient in the multidimensional tasks in a dynamic environment. Thus, multiple measures should be considered.…”

Section: Related Workmentioning

confidence: 99%

Multimodal-Multisensory Experiments

Razavi¹,

Yamauchi²,

Janfaza³

et al. 2020

Preprint

View full text Add to dashboard Cite

The human mind is multimodal. Yet most behavioral studies rely on century-old measures of behavior—task accuracy and latency (response time). Multimodal and multisensory analysis of human behavior creates a better understanding of how the mind works. The problem is that designing and implementing these experiments is technically complex and costly. This paper introduces versatile and economical means of developing multimodal-multisensory human experiments. We provide an experimental design framework that automatically integrates and synchronizes measures including electroencephalogram (EEG), galvanic skin response (GSR), eye-tracking, virtual reality (VR), body movement, mouse/cursor motion and response time. Unlike proprietary systems (e.g., iMotions), our system is free and open-source; it integrates PsychoPy, Unity and Lab Streaming Layer (LSL). The system embeds LSL inside PsychoPy/Unity for the synchronization of multiple sensory signals—gaze motion, electroencephalogram (EEG), galvanic skin response (GSR), mouse/cursor movement, and body motion—with low-cost consumer-grade devices in a simple behavioral task designed by PsychoPy and a virtual reality environment designed by Unity. This tutorial shows a step-by-step process by which a complex multimodal-multisensory experiment can be designed and implemented in a few hours. When conducting the experiment, all of the data synchronization and recoding of the data to disk will be done automatically.

show abstract

“…(2014) integrated questionnaires, qualitative methods, and physiological measures including ECG, respiration, electrodermal activity (EDA) and skin temperature to study activity settings in disabled youth [19]; they stated that using multiple measures reflects a better real-world setting of the youth experiences. Sciarini and Nicholson (2009) used EEG, eye blink, respiration, cardiovascular activity and speech measures in a workload task performance [20]; as they outlined, using only one measure is not sufficient in the multidimensional tasks in a dynamic environment. Thus, multiple measures should be considered.…”

Section: Related Workmentioning

confidence: 99%

Multimodal-Multisensory Experiments: Design and Implementation

Razavi

Yamauchi

Janfaza

et al. 2020

Preprint

View full text Add to dashboard Cite

The human mind is multimodal. Yet most behavioral studies rely on century-old measures of behavior - task accuracy and latency (response time). Multimodal and multisensory analysis of human behavior creates a better understanding of how the mind works. The problem is that designing and implementing these experiments is technically complex and costly. This paper introduces versatile and economical means of developing multimodal-multisensory human experiments. We provide an experimental design framework that automatically integrates and synchronizes measures including electroencephalogram (EEG), galvanic skin response (GSR), eye-tracking, virtual reality (VR), body movement, mouse/cursor motion and response time. Unlike proprietary systems (e.g., iMotions), our system is free and open-source; it integrates PsychoPy, Unity and Lab Streaming Layer (LSL). The system embeds LSL inside PsychoPy/Unity for the synchronization of multiple sensory signals - gaze motion, electroencephalogram (EEG), galvanic skin response (GSR), mouse/cursor movement, and body motion - with low-cost consumer-grade devices in a simple behavioral task designed by PsychoPy and a virtual reality environment designed by Unity. This tutorial shows a step-by-step process by which a complex multimodal-multisensory experiment can be designed and implemented in a few hours. When conducting the experiment, all of the data synchronization and recoding of the data to disk will be done automatically.

show abstract

Assessing Cognitive State with Multiple Physiological Measures: A Modular Approach

Cited by 12 publications

References 19 publications

Opensync: An Opensource Platform for Synchronizing Multiple Measures in Neuroscience Experiments

Opensync: An Opensource Platform for Synchronizing Multiple Measures in Neuroscience Experiments

Multimodal-Multisensory Experiments

Multimodal-Multisensory Experiments: Design and Implementation

Contact Info

Product

Resources

About