Despite the marked progress in recent years, structured light-based three-dimensional (3D) measurement techniques still have difficulty in capturing mirror surface reflection. The accuracy of 3D reconstruction for mirror objects should be further improved to adapt to the high reflectivity and curvature of such objects. To improve the stripe definition and reconstruction accuracy of highly reflective mirror objects, this paper analyzes the local blur of defocus stripes in phase measuring deflectometry (PMD) system, and presents a method to analyze the spatially varying defocusing and de-blurring, with the aid of a 3D block matching algorithm, thereby focusing on defocus stripes. Experimental results show that the proposed method can achieve micron-level reconstruction accuracy of standard flat mirrors, and detect the defects on highly reflective mirror objects at a high precision.