MagicChem: a MR system based on needs theory for chemical experiments

Abstract

Real chemical experiments may be dangerous or pollute the environment; meanwhile, the preparation of drugs and reagents is time-consuming. Due to the above-mentioned reasons, few experiments can be actually operated by students, which is not conducive to the chemistry learning and the phenomena principle understanding. Recently, due to the impact of Covid-19, many schools adopt online teaching, which is even more detrimental to students' learning of chemistry. Fortunately, MR(mixed reality) technology provides us with the possibility of solving the safety issues and breaking the space-time constraints, while the theory of human needs (Maslow's hierarchical needs) provides us with a way to design a comfortable and stimulant MR system with realistic visual presentation and interaction. The paper combines with the theory of human needs to propose a new needs model for virtual experiment. Based on this needs model, we design and develop a comprehensive MR system called MagicChem, which offers a robust 6-DoF interactive and illumination consistent experimental space with virtual-real occlusion, supporting realistic visual interaction, tangible interaction, gesture interaction with touching, voice interaction, temperature interaction, olfactory interaction and virtual human interaction. User study shows that MagicChem satisfies the needs model better than other MR experimental environments that partially meet the needs model. In addition, we explore the application of the needs model in VR environment.

User Experience Perspectives on the Application of Interactivity Design Based on Sensor Networks in Digital Museum Product Display

“…A sensor node is a miniature embedded system integrating multiple sensors and communication devices. In addition to sensing the surrounding environment, a sensor node must perform data fusion and forwarding, but it usually has limited energy storage, communication capability, and computational capacity [21]. Due to the self-organizing nature of wireless sensor networks, each sensor node in the network must have specific sensing, communication, and processing capabilities to collect practical information from changes in the surrounding environment, transmit data to and from neighboring nodes, and process the information.…”

May I Remain Seated: A Pilot Study on the Impact of Reducing Room-Scale Trainings to Seated Conditions for Long Procedural Virtual Reality Trainings

“…Recently, MHN has been used to guide the design of VR environments for long immersive sessions, such as Mixed Reality (MR) office environments, to ensure that the first three levels of MHN are considered to satisfy human deficient needs [14]. Similarly, another MR system has been developed guided by all levels of the MHN model in order to perform chemical experiments [24]. Regarding performance and motivation, a recent review showed that MHN has made significant contributions in management and organization of employees [25].…”

Review of Virtual Reality (VR) Applications To Enhance Chemical Safety: From Students to Plant Operators

“…VR has proven to be effective in providing comprehensive training in laboratories. For instance, Pan et al developed a mixed-reality (MR) system called MagicChem to train students on three tasks: reaction of sodium with water, exploring the temperature of the flame, and corrosion of stalactites . A total of 56 students participated in the study and were divided into four groups based on the learning environment.…”

“…For instance, Pan et al developed a mixed-reality (MR) system called MagicChem to train students on three tasks: reaction of sodium with water, exploring the temperature of the flame, and corrosion of stalactites. 50 A total of 56 students participated in the study and were divided into four groups based on the learning environment. Analysis of the system usability, user experience, and learning effect was done based on a questionnaire (objective and subjective).…”

“…In addition, the factors that need to be kept in consideration while developing a VR environment include ensuring higher visual fidelity (influences the sense of reality experience), natural operation, 50 and the ability to incorporate multiple-sensory simulations such as voice, temperature, and olfactory interactions for enhancing the experience as necessary. 50 Further, the developed VR tool should be free from stereo problems (where an object appears to one eye but not the other), peripheral problems (optical aberration issues such as distortion), and latency problems (that induce simulator sickness). Interested readers are referred to LaValle 19 for a detailed discussion on problems that should be addressed during the development of VR.…”