An Architecture Supporting Configurable Autonomous Multimodal Joint-Attention-Therapy for Various Robotic Systems

Groß, André; Schütze, Christian; Wrede, Britta; Richter, Birte

doi:10.1145/3536220.3558070

Cited by 5 publications

(11 citation statements)

References 15 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Through a shallow grid search, we obtained optimized results for all participants with a parameter setting of 500 trees, a maximum tree depth of 10, a minimum sample split of 3, and a minimum of 4 samples per leaf. Further, a combination of all features from the delta (1-4 Hz), theta (4-8 Hz), alpha (8-12 Hz), low beta (12)(13)(14)(15)(16)(17)(18)(19)(20), and high beta (20-30 Hz) bands binned in 2 Hz led to the optimal performance for 4-12 Hz in the first classification task (ambient vs. distraction) and for 4-20 Hz in the second classification (distraction vs. hesitation), and 62 × 5 = 310 and 62 × 9 = 558 dimensional feature vectors, respectively.…”

Section: Classificationmentioning

confidence: 99%

“…The following study would not have been conducted without LabLinking, since it builds on the complementary expertise and equipment of two laboratories: the Medical Assistance Systems Group (MAS) at Bielefeld University with its rich expertise in social robotics based on robots such as Pepper, Nao, or Flobi [19][20][21], and the Cognitive Systems Lab (CSL) at University of Bremen with vast experience in biosignal-adaptive cognitive systems [22] based on multimodal biosignal acquisition [23] and processing using machine learning methods [24], including the recording and interpretation of spoken communication [25] and high-density EEG in the context of intelligent robots and systems [26].…”

Section: Introductionmentioning

confidence: 99%

See 1 more Smart Citation

EEG Correlates of Distractions and Hesitations in Human–Robot Interaction: A LabLinking Pilot Study

Richter

Putze

Ivucic

et al. 2023

MTI

Self Cite

View full text Add to dashboard Cite

In this paper, we investigate the effect of distractions and hesitations as a scaffolding strategy. Recent research points to the potential beneficial effects of a speaker’s hesitations on the listeners’ comprehension of utterances, although results from studies on this issue indicate that humans do not make strategic use of them. The role of hesitations and their communicative function in human-human interaction is a much-discussed topic in current research. To better understand the underlying cognitive processes, we developed a human–robot interaction (HRI) setup that allows the measurement of the electroencephalogram (EEG) signals of a human participant while interacting with a robot. We thereby address the research question of whether we find effects on single-trial EEG based on the distraction and the corresponding robot’s hesitation scaffolding strategy. To carry out the experiments, we leverage our LabLinking method, which enables interdisciplinary joint research between remote labs. This study could not have been conducted without LabLinking, as the two involved labs needed to combine their individual expertise and equipment to achieve the goal together. The results of our study indicate that the EEG correlates in the distracted condition are different from the baseline condition without distractions. Furthermore, we could differentiate the EEG correlates of distraction with and without a hesitation scaffolding strategy. This proof-of-concept study shows that LabLinking makes it possible to conduct collaborative HRI studies in remote laboratories and lays the first foundation for more in-depth research into robotic scaffolding strategies.

show abstract

Section: Classificationmentioning

confidence: 99%

Section: Introductionmentioning

confidence: 99%

EEG Correlates of Distractions and Hesitations in Human–Robot Interaction: A LabLinking Pilot Study

Richter

Putze

Ivucic

et al. 2023

MTI

Self Cite

View full text Add to dashboard Cite

show abstract

“…Configurations of actions in this article follow the Behavior Markup Language (BML) ( Kopp et al, 2006 ) approach of an XML-based annotation for designing multimodal behaviors for robots. Like previous work ( Groß et al, 2022 ), the focus is mainly on behaviors for communication in a dialog but is not limited to these actions. • Speech : Processing the verbal voice output of a message.…”

Section: Risementioning

confidence: 99%

“…Robot Independence : The establishment of the fundamental structures enables the utilization of custom robots and actions. RISE builds on an existing system that constitutes its foundation ( Groß et al, 2022 ). Within this architecture, the most elemental actions of a robot are represented as Behavior Actions .…”

Section: Risementioning

confidence: 99%

“…The design process of these XML configurations, utilizing the principles of the BML ( Kopp et al, 2006 ), has undergone an initial pilot study evaluation. This small-scale study ( Groß et al, 2022 ) included a system-usability test with six participants (three computer and non-computer scientists each) investigating first concepts in a previous version of the RISE architecture. The results indicate that the usability of the scenario configuration was rated “good” by both groups.…”

Section: Rise In Applicationmentioning

confidence: 99%

See 1 more Smart Citation

RISE: an open-source architecture for interdisciplinary and reproducible human–robot interaction research

Groß,

Schütze,

Brandt

et al. 2023

Front. Robot. AI

Self Cite

View full text Add to dashboard Cite

In this article, we present RISE—a Robotics Integration and Scenario-Management Extensible-Architecture—for designing human–robot dialogs and conducting Human–Robot Interaction (HRI) studies. In current HRI research, interdisciplinarity in the creation and implementation of interaction studies is becoming increasingly important. In addition, there is a lack of reproducibility of the research results. With the presented open-source architecture, we aim to address these two topics. Therefore, we discuss the advantages and disadvantages of various existing tools from different sub-fields within robotics. Requirements for an architecture can be derived from this overview of the literature, which 1) supports interdisciplinary research, 2) allows reproducibility of the research, and 3) is accessible to other researchers in the field of HRI. With our architecture, we tackle these requirements by providing a Graphical User Interface which explains the robot behavior and allows introspection into the current state of the dialog. Additionally, it offers controlling possibilities to easily conduct Wizard of Oz studies. To achieve transparency, the dialog is modeled explicitly, and the robot behavior can be configured. Furthermore, the modular architecture offers an interface for external features and sensors and is expandable to new robots and modalities.

show abstract

Enabling Non-Technical Domain Experts to Create Robot-Assisted Therapeutic Scenarios via Visual Programming

Schütze

Groß

Wrede

et al. 2022

International Conference on Multimodal Interaction

View full text Add to dashboard Cite

An Architecture Supporting Configurable Autonomous Multimodal Joint-Attention-Therapy for Various Robotic Systems

Cited by 5 publications

References 15 publications

EEG Correlates of Distractions and Hesitations in Human–Robot Interaction: A LabLinking Pilot Study

EEG Correlates of Distractions and Hesitations in Human–Robot Interaction: A LabLinking Pilot Study

RISE: an open-source architecture for interdisciplinary and reproducible human–robot interaction research

Enabling Non-Technical Domain Experts to Create Robot-Assisted Therapeutic Scenarios via Visual Programming

Contact Info

Product

Resources

About