VR platform enabling crowdsourcing of embodied HRI experiments – case study of online robot competition

Inamura, Tetsunari; Mizuchi, Yoshiaki; Yamada, Hiroki

doi:10.1080/01691864.2021.1928551

Cited by 10 publications

(3 citation statements)

References 9 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Examples include a 'VRChat' [72] application able to implement collaborative VR user studies and future use could allow the co-design of digital resources with VR headset crowds [73]. Additionally, [77] created a cloud-based VR platform that enables crowdsourcing of HRI experiments, and initially tested in a competition where users interacted with a virtual robot through VR devices and the Internet.…”

Section: Crowdsource Resource Designmentioning

confidence: 99%

Eliciting Co-Creation Best Practices of Virtual Reality Reusable e-Resources

et al. 2023

View full text Add to dashboard Cite

Immersive experiential technologies find fertile grounds to grow and support healthcare education. Virtual, Augmented, or Mixed reality (VR/AR/MR) have proven to be impactful in both the educational and the affective state of the healthcare student’s increasing engagement. However, there is a lack of guidance for healthcare stakeholders on developing and integrating virtual reality resources into healthcare training. Thus, the authors applied Bardach’s Eightfold Policy Analysis Framework to critically evaluate existing protocols to determine if they are inconsistent, ineffective, or result in uncertain outcomes, following systematic pathways from concepts to decision-making. Co-creative VR resource development resulted as the preferred method. Best practices for co-creating VR Reusable e-Resources identified co-creation as an effective pathway to the prolific use of immersive media in healthcare education. Co-creation should be considered in conjunction with a training framework to enhance educational quality. Iterative cycles engaging all stakeholders enhance educational quality, while co-creation is central to the quality assurance process both for technical and topical fidelity, and tailoring resources to learners’ needs. Co-creation itself is seen as a bespoke learning modality. This paper provides the first body of evidence for co-creative VR resource development as a valid and strengthening method for healthcare immersive content development. Despite prior research supporting co-creation in immersive resource development, there were no established guidelines for best practices.

show abstract

Section: Crowdsource Resource Designmentioning

confidence: 99%

Eliciting Co-Creation Best Practices of Virtual Reality Reusable e-Resources

et al. 2023

View full text Add to dashboard Cite

show abstract

“…Consequently, many robot competitions have been canceled in the past year. To address this challenge, we organized an online and virtual robot competition 5 based on the SIGVerse system in 2020 (Inamura et al, 2021).…”

Section: Competition On a Cloud Systemmentioning

confidence: 99%

SIGVerse: A Cloud-Based VR Platform for Research on Multimodal Human-Robot Interaction

Inamura

Mizuchi

2021

Front. Robot. AI

Self Cite

View full text Add to dashboard Cite

Research on Human-Robot Interaction (HRI) requires the substantial consideration of an experimental design, as well as a significant amount of time to practice the subject experiment. Recent technology in virtual reality (VR) can potentially address these time and effort challenges. The significant advantages of VR systems for HRI are: 1) cost reduction, as experimental facilities are not required in a real environment; 2) provision of the same environmental and embodied interaction conditions to test subjects; 3) visualization of arbitrary information and situations that cannot occur in reality, such as playback of past experiences, and 4) ease of access to an immersive and natural interface for robot/avatar teleoperations. Although VR tools with their features have been applied and developed in previous HRI research, all-encompassing tools or frameworks remain unavailable. In particular, the benefits of integration with cloud computing have not been comprehensively considered. Hence, the purpose of this study is to propose a research platform that can comprehensively provide the elements required for HRI research by integrating VR and cloud technologies. To realize a flexible and reusable system, we developed a real-time bridging mechanism between the robot operating system (ROS) and Unity. To confirm the feasibility of the system in a practical HRI scenario, we applied the proposed system to three case studies, including a robot competition named RoboCup@Home. via these case studies, we validated the system’s usefulness and its potential for the development and evaluation of social intelligence via multimodal HRI.

show abstract

“…The core idea was to utilize a multi user collaborative work environment, collaborative platform, and well visible tasks for training, and to make judgments on problems by obtaining relevant information. Multiple different functional modules were used in virtual scenes to achieve interactive behavior [3][4]. This article adopted intelligent perception and DL technology to design intelligent interaction on the VR platform.…”

Section: Introductionmentioning

confidence: 99%

Exploration on Intelligent Interaction Design and User Experience of VR Platform Based on Intelligent Perception and Deep Learning

Zhang,

Zheng,

Yin

et al. 2024

Proceedings of the First International Conference on Science, Engineering and Technology Practices for Sustainable Development,

View full text Add to dashboard Cite

With the popularization of mobile terminals, the development and application fields of VR (virtual reality) technology are receiving increasing attention. Intelligent interactive systems play an important role in this field, and VR scenarios are a new way of digital information dissemination. This article took user experience as the starting point for research. Firstly, relevant literature at home and abroad was organized and summarized. Secondly, after analyzing the integration of existing mainstream platforms with deep learning (DL) theory, an intelligent interaction design platform based on DL model fusion was designed and developed, and experimental and evaluation results were compared and analyzed based on the algorithm. The test results showed that the overall flexibility of the system's interaction was over 70%; the overall delay rate was within 0.08; the tracking accuracy was above 89%. This indicated that through the optimization of DL algorithms, the intelligent interactive design VR platform can meet user needs.

show abstract

VR platform enabling crowdsourcing of embodied HRI experiments – case study of online robot competition

Cited by 10 publications

References 9 publications

Eliciting Co-Creation Best Practices of Virtual Reality Reusable e-Resources

Eliciting Co-Creation Best Practices of Virtual Reality Reusable e-Resources

SIGVerse: A Cloud-Based VR Platform for Research on Multimodal Human-Robot Interaction

Exploration on Intelligent Interaction Design and User Experience of VR Platform Based on Intelligent Perception and Deep Learning

Contact Info

Product

Resources

About