Natural Virtual Reality User Interface to Define Assembly Sequences for Digital Human Models

Abstract

Digital human models (DHMs) are virtual representations of human beings. They are used to conduct, among other things, ergonomic assessments in factory layout planning. DHM software tools are challenging in their use and thus require a high amount of training for engineers. In this paper, we present a virtual reality (VR) application that enables engineers to work with DHMs easily. Since VR systems with head-mounted displays (HMDs) are less expensive than CAVE systems, HMDs can be integrated more extensively into the product development process. Our application provides a reality-based interface and allows users to conduct an assembly task in VR and thus to manipulate the virtual scene with their real hands. These manipulations are used as input for the DHM to simulate, on that basis, human ergonomics. Therefore, we introduce a software and hardware architecture, the VATS (virtual action tracking system). This paper furthermore presents the results of a user study in which the VATS was compared to the existing WIMP (Windows, Icons, Menus and Pointer) interface. The results show that the VATS system enables users to conduct tasks in a significantly faster way.

Virtual Reality and Digital Human Modeling for Ergonomic Assessment in Industrial Product Development: A Patent and Literature Review

“…Table 2 shows the 18 articles selected by the search strategy. The Benefits of Human-centred Design in Industrial Practices: Re-design of Workstations in Pipe Industry 2017 [39] Integrating mocap system and immersive reality for efficient human-centred workstation design 2018 [40] Verification of HTC Vive deployment capabilities for ergonomic evaluations in virtual reality environments 2018 [6] A comparative study on computer-integrated set-ups to design human-centred manufacturing systems 2019 [1] An automatic procedure based on virtual ergonomic analysis to promote human-centric manufacturing 2019 [13] Applications and research trends of digital human models in the manufacturing industry 2019 [8] Ergonomics simulation in aircraft manufacturing-Methods and potentials 2019 [41] The effectiveness of virtual environments in developing collaborative strategies between industrial robots and humans 2019 [42] Application of Virtual Reality to Perform Ergonomic Risk Assessment in Industrialized Construction: Experiment Design 2020 [14] Natural virtual reality user interface to define assembly sequences for digital human model 2020 [5] The use and usage of virtual reality technologies in planning and implementing new workstations 2020 [7] Using Virtual Reality and Smart Textiles to Assess the Design of Workstations 2020 [43] Virtual Reality (VR): A Review on its Application in Construction Safety 2021 [16] Virtual reality simulation of human-robot coexistence for an aircraft final assembly line: process evaluation and ergonomics 2021 [30] Current Trends in Research and Application of Digital Human Modeling 2022…”

“…Figure 10 is an example of a construction industry study. Another 2 studies (12%) were concentrated on industrial plants manufacturing engine [14] and steel pipes [38], and 1 was focused on the energy industry [6].…”

“…Methods/Measurements [5,6,30,35,37,38,40,42] Rapid Upper Limb Assessment (RULA) [5,37,40] Rapid Entire Body Assessment (REBA) [1,30,36] Ergonomic Assessment Worksheet (EAWS) [35] National Institute for Occupational Safety and Health (NIOSH) [16] Ovako Working Posture Analysis System (OWAS) [1] Methods-Time Measurement (MTM-UAS) [14,41] Other (NASA-TLX questionnaire, Kinetic Energy ratio)…”

“…Yet, assessing ergonomic risks during the design phase enables detection of critical issues and the employment of corrective actions early in the process, which is more effective and less costly than later assessment of these risks [2,[14][15][16]. Furthermore, virtual reality may improve the realism and effectiveness of virtual manufacturing [13]; supplementing the constraints in the use of digital human modeling technology to assess physical ergonomics, supporting various aspects of the process, such as fidelity issues [17], the requirement for detailed knowledge about the visual behavior of the workers in the task being modelled [18], and the requirement of a high amount of training for engineers [14].…”

Development of Virtual Reality Automotive Lab for Training in Engineering Students

“…The aim purpose of this graphics implementation is that the virtual world has a real aspect (virtual realism), real sound (auditive realism), and the user feels like part of that environment (haptic realism) [2]. Therefore, these aspects could be carried out through optic devices, electronics, and computational implementations to have a visual representation and a hand simulation to realize different tasks inside the virtual environment such as pick up, place, alter and order objects taking into consideration their hand position and movements [3].…”