Projector-based augmented reality with simultaneous 3D inspection using a single DMD

Drouin, Marc-Antoine; Boisvert, Jonathan; Godin, Guy; Dicaire, Louis-Guy; Picard, Michel

doi:10.1117/12.2545377

Cited by 1 publication

(4 citation statements)

References 24 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Furthermore, in our architecture we propose the employment of a single projector. The use of a single projection system is not only cost effective but also negates complexity arising from multi-perspective registration and parallax-based occlusion from multi-projector systems [ 25 ]. Since the color and reflectance of the surface are likely to affect projected virtual information [ 17 ] we select a diffuse flat surface of the switchable glass as the incident projective image plane.…”

Section: Methodsmentioning

confidence: 99%

“…In this regard, and following [34] where contextual image references are preferred to static ones, we seek to contextualize the reference image by projecting the images right next to the target region of interest within the field of view of the operator. Laser SAR [24] Large Scale [9] 3D Object [25] Proposed…”

Section: Related Studiesmentioning

confidence: 99%

“…Generally, AR has been demonstrated to increase operator’s performance in maintenance [ 11 ], assembly, inspection, design and development [ 13 ] tasks, as well as an organization’s competitive advantage from efficient training [ 24 ]. With regard to inspection tasks using SAR, a number of studies have focused on spot welding [ 9 , 13 , 15 , 24 ], 3D objects [ 25 ], and none to the best of our ability has focused on safe collaborative/cooperative inspection of PCBAs with contextualization enabled by switchable glass. Therefore, we propose a system that focuses on value addition by leveraging on existing defect information in automatic optical inspection (AOI) to wirelessly localize defects on PCBAs, contextualize rendered reference images on switchable glass and perform gesture-based interactions in a safe manner.…”

Section: Introductionmentioning

confidence: 99%

“…The authors in [ 25 ] present an inspection system that uses a single projector, simultaneously identifying possible defects and displaying its outcome on the component. However, this system suffers from the drawback of unavailable color maps arising from monochromatic augmentation of its video stream which would render it ineffective for our inspection task.…”

Section: Introductionmentioning

confidence: 99%

See 3 more Smart Citations

Switchable Glass Enabled Contextualization for a Cyber-Physical Safe and Interactive Spatial Augmented Reality PCBA Manufacturing Inspection System

Runji

Lin

2020

Sensors

View full text Add to dashboard Cite

Augmented reality (AR) has been demonstrated to improve efficiency by up to thrice the level of traditional methods. Specifically, the adoption of visual AR is performed widely using handheld and head-mount technologies. Despite spatial augmented reality (SAR) addressing several shortcomings of wearable AR, its potential is yet to be fully explored. To date, it enhances the cooperation of users with its wide field of view and supports hands-free mobile operation, yet it has remained a challenge to provide references without relying on restrictive static empty surfaces of the same object or nearby objects for projection. Towards this end, we propose a novel approach that contextualizes projected references in real-time and on demand, onto and through the surface across a wireless network. To demonstrate the effectiveness of the approach, we apply the method to the safe inspection of printed circuit board assembly (PCBA) wirelessly networked to a remote automatic optical inspection (AOI) system. A defect detected and localized by the AOI system is wirelessly remitted to the proposed remote inspection system for prompt guidance to the inspector by augmenting a rectangular bracket and a reference image. The rectangular bracket transmitted through the switchable glass aids defect localization over the PCBA, whereas the image is projected over the opaque cells of the switchable glass to provide reference to a user. The developed system is evaluated in a user study for its robustness, precision and performance. Results indicate that the resulting contextualization from variability in occlusion levels not only positively affect inspection performance but also supersedes the state of the art in user preference. Furthermore, it supports a variety of complex visualization needs including varied sizes, contrast, online or offline tracking, with a simple robust integration requiring no additional calibration for registration.

show abstract

Section: Methodsmentioning

confidence: 99%