Multi robots interactive control using mixed reality

Ostanin, Mikhail; Yagfarov, Rauf; Devitt, Dmitry; Akhmetzyanov, Aydar; Klimchik, Alexandr

doi:10.1080/00207543.2020.1834640

Cited by 21 publications

(3 citation statements)

References 25 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Mixed reality is the blending of physical and digital environments to create an immersive experience, including AR, VR, and other hybrid realities [14]. MR can be used for a variety of purposes, including entertainment, education, training, and healthcare [15]. Mixed reality is used in entertainment, education, and training to create immersive experiences in video games, theme parks, and movies.…”

Section: Mixed Reality (Mr)mentioning

confidence: 99%

A Digital Painting Learning Model Using Mixed-Reality Technology to Develop Practical Skills in Character Design for Animation

Piankarnka,

Lertbumroongchai,

Piriyasurawong

2023

Advances in Human-Computer Interaction

View full text Add to dashboard Cite

This research aims to (1) synthesize the digital painting learning process by using mixed-reality technology to develop practical skills in character design for animation and (2) develop and evaluate digital painting learning models using mixed-reality technology to develop practical skills in character design for animation. This research was conducted by studying documentation and related research and designing digital painting learning models using mixed-reality technology to develop practical skills in character design for animation. Using a questionnaire, a total of 9 experts evaluated the model’s suitability. The statistics used in the research were the mean and standard deviation. The study found that a component of the digital painting learning process involves using mixed-reality technology to develop practical skills in character design for animation. It consists of the following four components: (1) input data, (2) the digital painting learning process, (3) output assessment, and (4) feedback. The expert’s evaluation of the model’s suitability found that the digital painting learning model using mixed-reality technology to develop practical skills in character design for animation was at the highest level (mean ± SD = 4.38 ± 0.21). This research is beneficial to faculty who teach character design and development for animation. The results of the study can be applied to teaching and learning.

show abstract

Section: Mixed Reality (Mr)mentioning

confidence: 99%

A Digital Painting Learning Model Using Mixed-Reality Technology to Develop Practical Skills in Character Design for Animation

Piankarnka,

Lertbumroongchai,

Piriyasurawong

2023

Advances in Human-Computer Interaction

View full text Add to dashboard Cite

show abstract

“…Robotic Operating System and Unity were used to design the system and tested in diverse settings. In another work, researchers presented an interactive control framework for both single and multirobot systems using mixed reality for various applications [ 37 ]. The system allowed interaction with robots by focusing on the visualization of their objective, and it could relate to any robots and mixed reality interfaces.…”

Section: Introductionmentioning

confidence: 99%

A Novel Framework for Mixed Reality–Based Control of Collaborative Robot: Development Study

Shahria¹,

Sunny²,

Zarif³

et al. 2022

JMIR Biomed Eng

View full text Add to dashboard Cite

Background Applications of robotics in daily life are becoming essential by creating new possibilities in different fields, especially in the collaborative environment. The potentials of collaborative robots are tremendous as they can work in the same workspace as humans. A framework employing a top-notch technology for collaborative robots will surely be worthwhile for further research. Objective This study aims to present the development of a novel framework for the collaborative robot using mixed reality. Methods The framework uses Unity and Unity Hub as a cross-platform gaming engine and project management tool to design the mixed reality interface and digital twin. It also uses the Windows Mixed Reality platform to show digital materials on holographic display and the Azure mixed reality services to capture and expose digital information. Eventually, it uses a holographic device (HoloLens 2) to execute the mixed reality–based collaborative system. Results A thorough experiment was conducted to validate the novel framework for mixed reality–based control of a collaborative robot. This framework was successfully applied to implement a collaborative system using a 5–degree of freedom robot (xArm-5) in a mixed reality environment. The framework was stable and worked smoothly throughout the collaborative session. Due to the distributed nature of cloud applications, there is a negligible latency between giving a command and the execution of the physical collaborative robot. Conclusions Opportunities for collaborative robots in telerehabilitation and teleoperation are vital as in any other field. The proposed framework was successfully applied in a collaborative session, and it can also be applied in other similar potential applications for robust and more promising performance.

show abstract

“…and Nanotechnology (ASPEN 2022) 15-18 November 2022, Singapore. Edited by Nai Mui Ling Sharon and A. Senthil Kumar HoloLens user in real-time with the map overlaid on the physical world (5,6). Despite the potential for online robot motion planning on the digital map via the MR interface, it cannot overcome the HoloLens' limitation which the accuracy of the far interaction inversely correlates to the distance from the HoloLens user.…”

Section: Introductionmentioning

confidence: 99%

A Mixed Reality Platform for Online Motion Planning of Mobile Robots via Hololens 2

Yu¹,

Arora²,

Song³

et al. 2022

Asian Society for Precision Engineering and Nanotechnology (ASPEN 2022)

View full text Add to dashboard Cite

Multi robots interactive control using mixed reality

Cited by 21 publications

References 25 publications

A Digital Painting Learning Model Using Mixed-Reality Technology to Develop Practical Skills in Character Design for Animation

A Digital Painting Learning Model Using Mixed-Reality Technology to Develop Practical Skills in Character Design for Animation

A Novel Framework for Mixed Reality–Based Control of Collaborative Robot: Development Study

A Mixed Reality Platform for Online Motion Planning of Mobile Robots via Hololens 2

Contact Info

Product

Resources

About