Integrated product design and assembly planning in an augmented reality environment

Abstract

Purpose -The purpose of this paper is to present a methodology that integrates design and assembly planning in an augmented reality (AR) environment. Intuitive bare-hand interactions (BHIs) and a combination of virtual and real objects are used to perform design and assembly tasks. Ergonomics and other assembly factors are analysed during assembly evaluation. Design/methodology/approach -An AR design and assembly (ARDnA) system has been developed to implement the proposed methodology. For design generation, 3D models are created and combined together like building blocks, taking into account the product assembly in the early design stage. Detailed design can be performed on the components and manual assembly process is simulated to evaluate the assembly design. Findings -A case study of the design and assembly of a toy car is conducted to demonstrate the application of the methodology and system.Research limitations/implications -The system allows the users to consider the assembly of a product when generating the design of the components. BHI allows the users to create and interact with the virtual modes with their hands. Assembly evaluation is more realistic and takes into consideration the ergonomics issues during assembly. Originality/value -The system synthesizes AR, BHI and a CAD software to provide an integrated approach for design and assembly planning, intuitive and realistic interaction with virtual models and holistic assembly evaluation.

Augmented reality technology in the manufacturing industry: A review of the last decade

“…AR (Reif and G€ unthner, 2009;Reif et al, 2010;Krajcovic et al, 2014) have finally applied AR to improve the accuracy and efficiency of the order picking process. Among the technical aspects, bare-hand solutions have been implemented quite frequently in industry, especially in the field of assembly (Ong and Wang 2011;Ng et al, 2013;Wang et al, 2016c). "Bare-hand" means that no device has to be worn to interact with a computer; rather, the position of the hand and the fingers is used to control applications directly.…”

“…Vignais et al (2013) have instead proposed an AR-based tool for the evaluation of ergonomic conditions of workers, with a particular attention on the potential risks for musculoskeletal disorders. Ng et al (2013) have addressed ergonomic issues related to an AR-based assembly process. Remote applications with the use of AR have been proposed by Adcock and Gunn (2015), Gurevich et al (2015), Mourtzis et al (2017), and Neges et al (2017).…”

Augmented Reality Marketing in Malaysia—Future Scenarios

“…Augmented Reality (AR) is the integration of computer-created objects, such as a picture or video overlay, in a real world image, through technological devices such as a smartphone, a desktop, and eye-glasses (Imbert et al 2013;Lazim and Rahman 2015). It enables augmented stimulation by tracking the real-world objects or environment and registers the virtual contents onto them which provides the user with a stimulating experience and the ability to observe, in a distinct environment (Huang and Hsu Liu 2014;Ng et al 2013). The AR technology allows the presence of the user in two different spectra, the real and the virtual world, at the same time.…”

Assembly planning and evaluation in an augmented reality environment

“…The deviation of the wrist angles of the hand is calculated based on the transformation of the HCS from the neutral posture HCS np to the current posture HCS cp (Ng et al 2013). HCS np is defined as the posture where the bones of the fingers and forearm are roughly parallel (Carey and Gallwey 2002;Khan, O'Sullivan, and Gallwey 2010).…”