Spatial Augmented Reality: an application for human work in smart manufacturing environment

Mengoni, Maura; Ceccacci, Silvia; Generosi, Andrea; Leopardi, Alma

doi:10.1016/j.promfg.2018.10.072

Cited by 52 publications

(32 citation statements)

References 17 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Additionally, we employ the retrieved information to calibrate the switchable glass position for subsequent interpolation during human activity recognition. Kinect is a low-cost solution able to that directly provides color and depth information [ 42 ] generating 3D position with demonstrated precision [ 30 ] rendering it as a practical and accessible solution without interfering with its projection [ 43 ].…”

Section: Methodsmentioning

confidence: 99%

“…This system, however, is not collaborative and does not contextualize projected reference instructions as we are able to demonstrate. The authors in [ 30 ] demonstrate an SAR system that aids manual workers perform assembly tasks by conveying technical instructions in the FOV, monitors the workers’ safety and tracks their postures to eliminate the risk of musculoschelectric seizures. Their proposed system consists of 1 projector, 2 RGB-D cameras and 1 RGB camera.…”

Section: Introductionmentioning

confidence: 99%

See 1 more Smart Citation

Switchable Glass Enabled Contextualization for a Cyber-Physical Safe and Interactive Spatial Augmented Reality PCBA Manufacturing Inspection System

Runji

Lin

2020

Sensors

View full text Add to dashboard Cite

Augmented reality (AR) has been demonstrated to improve efficiency by up to thrice the level of traditional methods. Specifically, the adoption of visual AR is performed widely using handheld and head-mount technologies. Despite spatial augmented reality (SAR) addressing several shortcomings of wearable AR, its potential is yet to be fully explored. To date, it enhances the cooperation of users with its wide field of view and supports hands-free mobile operation, yet it has remained a challenge to provide references without relying on restrictive static empty surfaces of the same object or nearby objects for projection. Towards this end, we propose a novel approach that contextualizes projected references in real-time and on demand, onto and through the surface across a wireless network. To demonstrate the effectiveness of the approach, we apply the method to the safe inspection of printed circuit board assembly (PCBA) wirelessly networked to a remote automatic optical inspection (AOI) system. A defect detected and localized by the AOI system is wirelessly remitted to the proposed remote inspection system for prompt guidance to the inspector by augmenting a rectangular bracket and a reference image. The rectangular bracket transmitted through the switchable glass aids defect localization over the PCBA, whereas the image is projected over the opaque cells of the switchable glass to provide reference to a user. The developed system is evaluated in a user study for its robustness, precision and performance. Results indicate that the resulting contextualization from variability in occlusion levels not only positively affect inspection performance but also supersedes the state of the art in user preference. Furthermore, it supports a variety of complex visualization needs including varied sizes, contrast, online or offline tracking, with a simple robust integration requiring no additional calibration for registration.

show abstract

Section: Methodsmentioning

confidence: 99%

Section: Introductionmentioning

confidence: 99%

Switchable Glass Enabled Contextualization for a Cyber-Physical Safe and Interactive Spatial Augmented Reality PCBA Manufacturing Inspection System

Runji

Lin

2020

Sensors

View full text Add to dashboard Cite

show abstract

“…The AR-based instructions was also helpful for assembly order should be memorized [12]. Mengoni et al [13] presented a spatial augmented reality (SAR) based ARASS. The SAR system was compared with a 2D monitor based assembly supporting system.…”

Section: Efficiency Evaluation Of Arassmentioning

confidence: 99%

Bare-Hand Depth Perception Used in Augmented Reality Assembly Supporting

Liang

Yueming

2020

IEEE Access

View full text Add to dashboard Cite

Augmented Reality (AR) had been used in mechanical assembly supporting. The current reported researches of AR assembly supporting system (ARASS) less concerned about the interaction between the operators' hands and virtual objects, especially on the occlusion between hands and virtual objects. The correct occlusion results would make ARASS more immersive and then the operators' interaction experiences were increased. To address this issue, this paper presented a bared-hand depth perception method that was designed for improving interaction experience in ARASS. The method was based on an interaction scene that was designed for AR mechanical assembly supporting. The method consisted of two components: hand segmentation and hand mesh generation. Hand segmentation method segmented operator's hand areas from depth image of scene and divided hand area into several sub areas that provided hand information. Hand surface mesh generation method generated hand surface meshes in 3D space based on the results of hand segmentation. The meshes were used to solve the occlusion problem of hand area in AR scene. The results verified that the bared-hand depth perception method could handle the occlusion between operator's hands and virtual objects correctly in real-time and recognize hand information in a limited space. The method could increase operators' depth perception of bared hand and make ARASS more immersive. INDEX TERMS Augmented assembly, augmented reality, hand depth perception.

show abstract

“…In order to amend the manufacturing environment, Mengoni et al [16] proposed a novel Spatial AR (SAR)-based system. To support manual work, and to complement the current AR systems in use, the authors have developed a system which could be utilized in smart factories.…”

Section: Adoption and Challenges Of Ar/vr Glassesmentioning

confidence: 99%

“…Mengoni et al [16] state that while AR is widely used, most employ multimedia devices, such as smartphones, HMDs, and screens. The use of an SAR-based system enables the operators to exclusively focus on the workstation, and not be distracted by having to constantly peek at the screen situated beside the workstation (and not directly on it).…”

Section: Adoption and Challenges Of Ar/vr Glassesmentioning

confidence: 99%

Striving for a Safer and More Ergonomic Workplace: Acceptability and Human Factors Related to the Adoption of AR/VR Glasses in Industry 4.0

Sik-Lányi

Withers

2020

Smart Cities

View full text Add to dashboard Cite

The word smart is very popular these days, as a result of nearly everything being digital today. Background information: In this digital world, everything is interconnected by smart devices. The driving force behind this is today’s Industry 4.0 environment, which is affected by many factors, including the ergonomic and safe design of new technology, ensuring the safety of factory operators, whilst increasing productivity and profits. The authors answer the following research questions: Are AR/VR systems or devices proposed for industrial use capable of meeting the needs of the industry (including sustainability)? Are these AR/VR devices designed to ensure easy use and efficient training of factory operators? Do the proposals of the reviewed research papers place sufficient emphasis on creating ergonomic workplaces? These publications were categorized into three subcategories based on the used key technology, research or application area, and their main purposes. Conclusion: Virtual reality, augmented reality, and IoT are becoming increasingly more suitable for industrial use, despite facing scrutiny and criticism.

show abstract

Spatial Augmented Reality: an application for human work in smart manufacturing environment

Cited by 52 publications

References 17 publications

Switchable Glass Enabled Contextualization for a Cyber-Physical Safe and Interactive Spatial Augmented Reality PCBA Manufacturing Inspection System

Switchable Glass Enabled Contextualization for a Cyber-Physical Safe and Interactive Spatial Augmented Reality PCBA Manufacturing Inspection System

Bare-Hand Depth Perception Used in Augmented Reality Assembly Supporting

Striving for a Safer and More Ergonomic Workplace: Acceptability and Human Factors Related to the Adoption of AR/VR Glasses in Industry 4.0

Contact Info

Product

Resources

About