Well-focused and sharp target images are essential in traditional calibration, but they generally cause difficulty and inconvenience in image acquisition in practical applications. To address this problem, a stable and effective calibration method for defocused cameras is proposed in this study. Firstly, the two speckle patterns are created, one of which is with control points to estimate the initial value and the other used for point pair match registration is without control points. They are subsequently displayed on a fixed monitor and captured at each camera pose. Secondly, the initial guess for the control points was estimated using the proposed method. The retrieval of query points can then be done with high accuracy using the digital image correlation (DIC) algorithm. Finally, all the calibration parameters, including lens distortion, were calculated using the plane calibration algorithm. The experiment in this study demonstrated the practicality and effectiveness of the proposed method. The accuracy and precision were quantitatively evaluated by the mean reprojection errors, which were 0.057 pixels.