Combining virtual reality enabled simulation with 3D scanning technologies towards smart manufacturing

Hutabarat, Windo; Oyekan, John; Turner, Christopher; Tiwari, Ashutosh; Prajapat, Neha; Gan, Xiao-Peng; Anthony, Waller

doi:10.1109/wsc.2016.7822314

Cited by 15 publications

(7 citation statements)

References 22 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Turner et al [66] make the point that the use of Augmented Reality technologies may allow for the real time overlay of Discret e Event Simulation model layouts over live production line scenes, via headsets and handheld devices, allowing for round trip decision making to be facilitated though such Mixed Reality environments. Hutabarat et al [67] m a k e t h e case that Virtual Reality renderings of manufacturing scenarios may be enhanced through the use of motion and depth sensing technologies such as Kinect. In [67] industrial shop floor layouts are considered and models built that allo w for user manipulation of Discrete Event Simulations via workers' voice commands and movements in real tim e. Th e use of RFID (Radio-Frequency IDentification) tags to track and control logistics processes on the shop floor has been explored by [68]; with a particular focus on the visualizatio n of logistics trajectories the paper proposes a logistics object based on RFID cuboid da ta structure, enabling simplified views of raw sensor derived data.…”

Section: Visualization and Interactionmentioning

confidence: 99%

“…Hutabarat et al [67] m a k e t h e case that Virtual Reality renderings of manufacturing scenarios may be enhanced through the use of motion and depth sensing technologies such as Kinect. In [67] industrial shop floor layouts are considered and models built that allo w for user manipulation of Discrete Event Simulations via workers' voice commands and movements in real tim e. Th e use of RFID (Radio-Frequency IDentification) tags to track and control logistics processes on the shop floor has been explored by [68]; with a particular focus on the visualizatio n of logistics trajectories the paper proposes a logistics object based on RFID cuboid da ta structure, enabling simplified views of raw sensor derived data. Negri et al [69] and Cimino et al [70] highlight the role that Cyber Physical Systems are likely to play in the future of manufacturing and discuss their management and control via Digital Twin visualiza tions.…”

Section: Visualization and Interactionmentioning

confidence: 99%

“…If accepted, send in one direction, if rejected, send in the other. Vision could also be used to collect da ta from legacy machines using techniques described in [88]. The quality of visual processing has improved considerably wit h the popularity of software/hardware toolkits.…”

Section: Collaborative Roboticsmentioning

confidence: 99%

See 2 more Smart Citations

Human in the Loop: Industry 4.0 Technologies and Scenarios for Worker Mediation of Automated Manufacturing

Turner

Chen

et al. 2021

IEEE Access

Self Cite

View full text Add to dashboard Cite

Industry 4.0 derived technologies have the potential to enable a new wave of digital manufacturing solutions for semi and fully automated production. In addition, this paradigm enco m p a s ses the use of communication technologies to transmit data to processing stations as well as the utilization of cloud based computational resources for data mining. Despite the rise in automation, future manufactu rin g systems will initially still require humans in the loop to provide supervisory level mediation for even the most autonomous production scenarios. Through a structured review, this paper details a number of key technologies that are most likely to shape this future and describes a range of scenarios for their use in delivering human mediated automated and autonomous production. This paper argues that in all cases of future manufacturing management it is key that the human has oversight of critical information flows and remains an active participant in the delivery of the next generation of production systems.

show abstract

Section: Visualization and Interactionmentioning

confidence: 99%

Section: Visualization and Interactionmentioning

confidence: 99%

See 1 more Smart Citation

Human in the Loop: Industry 4.0 Technologies and Scenarios for Worker Mediation of Automated Manufacturing

Turner

Chen

et al. 2021

IEEE Access

Self Cite

View full text Add to dashboard Cite

show abstract

“…Lu et al 95 Dorozhkin et al 61 Lindskog et al 80 Rubio et al 89 Mujber et al 82 Chan et al 55 Zhou et al 110 Murphy and Perera 83 Hutabarat et al 48 Rohrer 15 Mueller-Wittig et al 47 Akpan and Brooks 11…”

Section: Manufacturingmentioning

confidence: 99%

A comparative evaluation of the effectiveness of virtual reality, 3D visualization and 2D visual interactive simulation: an exploratory meta-analysis

Akpan

Shanker

2018

SIMULATION

View full text Add to dashboard Cite

Research on the application of 3D visualization and virtual reality (VR) in discrete-event simulation (DES) has received increased attention in the past two decades. The increasing popularity of the 3D display in DES is mainly due to superior display capabilities and the associated benefits that it offers. However, the 2D display also continues to enjoy active use to date, thus provoking some fierce debates questioning the need for the 3D and VR if the 2D interface suffices. Several studies comparing the effectiveness of the different visualization methods also produce different conclusions. This paper undertakes a meta-analysis of the different positions and synthesizes the findings from 162 studies on the impacts of the 2D display versus 3D/VR on user performance on various DES tasks. The results highlight four key findings. First, the perception that the 2D display is more effective for model development is misleading as 3D/VR offers overall better performance and quality of models. Second, 3D/VR enables more effective performance than 2D display for model verification and validation. Third, 3D/VR decreases the time taken for verification, validation, experimentation, and analysis of results, but can increase model development time. Finally, the latent variables such as the application domains and nature of the problems tackled have no direct or indirect influence on the efficacy of the 3D display/VR versus 2D on DES task performance.

show abstract

“…Zielinski et al [2] developed the 3D visualization by using the Oculus Rift SDK and using MATLAB to transform 2D desktop display to 3D display in VR robotics collaboration. Besides the application of the virtual reality in games, applications have also been gradually introduced to research and development of other industries [3], e.g., the equipment manufacturing exhibition of 3D interactive media [ 4 ], motion of machine tool [ 5 ], machine tool-aided design [6], home design [7], smart manufacturing [8], robotic arm dynamic and simulation [9], creating new museum experiences [10], reducing work accidents [11] and education [12,13,14,15]. In the application to education, the user experience has been studied [12].…”

Section: Introductionmentioning

confidence: 99%

Case study of virtual reality in CNC machine tool exhibition

et al. 2017

View full text Add to dashboard Cite

Abstract. Exhibition and demonstration are generally used in the promotion and sale-assistance of manufactured products. However, the transportation cost of the real goods from the vender factory to the exposition venue is generally expensive for huge and heavy commodity. With the advancement of computing, graphics, mobile apps, and mobile hardware the 3D visibility technology is getting more and more popular to be adopted in visual-assisted communication such as amusement games. Virtual reality (VR) technology has therefore being paid great attention in emulating expensive small and/or huge and heavy equipment. Virtual reality can be characterized as 3D extension with Immersion, Interaction and Imagination. This paper was then be focused on the study of virtual reality in the assistance of CNC machine tool demonstration and exhibition. A commercial CNC machine tool was used in this study to illustrate the effectiveness and usability of using virtual reality for an exhibition. The adopted CNC machine tool is a large and heavy mill-turn machine with the width up to eleven meters and weighted about 35 tons. A head-mounted display (HMD) was attached to the developed VR CNC machine tool for the immersion viewing. A user can see around the 3D scene of the large mill-turn machine and the operation of the virtual CNC machine can be actuated by bare hand. Coolant was added to demonstrate more realistic operation while collision detection function was also added to remind the operator. The developed VR demonstration system has been presented in the 2017 Taipei International Machine Tool Show (TIMTOS 2017). This case study has shown that young engineers and/or students are very impressed by the VR-based demonstration while elder persons could not adapt themselves easily to the VR-based scene because of eyesight issues. However, virtual reality has successfully being adopted and integrated with the CNC machine tool in an international show. Another machine tool on laser-assisted milling machine motion simulation has also been successfully conducted to show the expandability of the VR based technology. One can conclude that VR will be adopted and paid more and more attention in the future in helping CNC machine tool promotion. Further study could be extended to education and training system, and also for the maintenance system, too.

show abstract

Combining virtual reality enabled simulation with 3D scanning technologies towards smart manufacturing

Cited by 15 publications

References 22 publications

Human in the Loop: Industry 4.0 Technologies and Scenarios for Worker Mediation of Automated Manufacturing

Human in the Loop: Industry 4.0 Technologies and Scenarios for Worker Mediation of Automated Manufacturing

A comparative evaluation of the effectiveness of virtual reality, 3D visualization and 2D visual interactive simulation: an exploratory meta-analysis

Case study of virtual reality in CNC machine tool exhibition

Contact Info

Product

Resources

About