SGVM: Semantic-Guided Variational Model for Sealing Nail Defect Extraction Within Albedo Domain via Photometric Stereo

Abstract

Automatic 2D vision-based defect detection on sealing nail (SealN) surfaces is challenging due to interference of complex backgrounds with non-homogeneous and low contrast between foreground and background. Inspired by an interesting observation that the albedo domain recovered by the uncalibrated photometric stereo (UPS) shows obvious differences and significant abruptness between defects' and nondefects' regions, we develop a novel semantic-guided variational model (SGVM) to conditional extract structural defects from albedo map. Specifically, SGVM utilizes one developed global regularized label indicator to semantically guide one local regularized relative Gaussian filter (RGF) for achieving large-scale structures (i.e., defects) preservation and small-scale textures (i.e., background) suppression. Furthermore, defects can be efficiently extracted by thresholding the structure map within the label indicator. Additionally, experimental results on numerous challenging defect images reveal that the proposed SGVM outperforms the existing advanced 2D methods in terms of defect extraction. INDEX TERMSSemantic-guided Variational Model (SGVM), Defect Extraction, Sealing Nail, Albedo Domain, Uncalibrated Photometric Stereo (UPS).