Future Application of Multisensory Mixed Reality in the Human Cyber—physical System

Abstract

Mixed reality as an emerging technology can improve users' experience. Using this technology, people can interact between virtual objects and the real world. Mixed reality has enormous potential for enhancing the human cyber-physical system for different manufacturing functions: planning, designing, production, monitoring, quality control, training, and maintenance. This study aims to understand the existing development of mixed reality technology in manufacturing by analysing patent publications from the InnovationQ-Plus database. Evaluations of trends in this developing technology have focused on qualitative literature reviews and insufficiently on patent technology analytics. Patents connected to mixed reality will be mapped to give technology experts a better grasp of present progress and insights for future technological development in the industry. Thus 709 patent publications are systematically identified and analysed to discover the technological trends. In addition, we map existing patent publications with manufacturing functions, and illustrate this with a technology function matrix. Finally, we identify future research in human cyber-physical system development by enhancing different human senses to give users more sensations while interacting with virtual objects. We provide insight into this human cyber-physical system development in three industries: automotive, food and beverage, and textiles. OPSOMMINGGemengde-werklikheid is ʼn opkomende tegnologie wat gebruikers se ervaring kan verbeter. Hierdie tegnologie laat mense toe om interaksie te hê met virtuele voorwerpe in die regte wêreld. Gemengde-werklikheid het baie potensiaal om die mens-kuber-fisiese stelsel vir verskeie vervaardigingsprosesse te verbeter, soos beplanning, ontwerp, produksie, monitering, gehaltebeheer, opleiding en instandhouding. Hierdie studie ondersoek die ontwikkeling van gemengde-werklikheid tegnologie in vervaardiging deur ʼn hersiening van patente in die InnovationQ-Plus databasis. Tendense in hierdie ontwikkelende tegnologie fokus op kwalitatiewe literatuurstudies eerder as op kwantitatiewe patent tegnologie ontledings. Patente wat met gemengde-werklikheid assosieer word, word gekarteer om tegnologiekenners ʼn beter begrip van bestaande vordering en insigte vir toekomstige ontwikkeling in die bedryf te gee. So word 709 patente sistemies identifiseer en ontleed om die tendense te ontdek. Verder word bestaande patente gekarteer volgens vervaardigingsfunksies -dit word met ʼn tegnologiefunksiematriks illustreer. Laastens word toekomstige navorsing oor mens-kuber-fisiese stelselontwikkeling identifiseer deur verskillende sintuie te gebruik om gebruikers meer sensasies te gee wanneer hulle met virtuele voorwerpe werk. Insig word spesifiek in die motor, voedsel-en drank-, en tekstielbedryf verskaf.

Immersive Technologies in Indonesia Faces "New Normal" COVID-19

“…As a result, it is possible to increase the user interaction level, but at the same time, it will reduce the user immersion level. To overcome the immersive problem, MR combines the virtual and real worlds, supported by a high degree of connected devices to enhance a user's experience and allow for near-seamless interaction between both worlds (Rokhsaritalemi, et al, 2020;Santoso et al, 2021).…”