Active infrared thermography has been extensively employed in non-destructive testing in a wide variety of fields. It is capable of extracting defect information of tested object based on the infrared thermal image sequence. However, conventional infrared thermal images are often subjected to defect information with low pixel resolution, and defects are difficult to quantitatively analyze. By exploiting flat-bottomed holes in a PVC plate as defect specimens, a method for quantitative defect depth recognition based on the fusion principal component analysis algorithm with sliding-window mechanism and the 1DResnet50-CBAM (One Dimensional - Residual Neural Network - Convolutional Block Attention Module) model was proposed for the reconstructed image sequence of active infrared thermography to address the above-described issues in this study. First, defect information and location were extracted from the original infrared sequence thermal image of the specimen using principal component analysis algorithm with sliding-window mechanism. Then, the dimension of the defect data was reduced using the temporal characteristic of the infrared temperature field. That is, the three-dimensional (3D) defect data were transformed into one-dimensional (1D) temporal infrared thermal signal. Moveover, the 1D infrared signal time series corresponding to the defect pixel points in the infrared sequence image served as the input to the network, and the defect depth served as the output for automatic defect detection and depth quantification. As indicated by the results, the proposed method based on the fusion principal component analysis algorithm with sliding-window mechanism and 1DResnet50-CBAM model is capable of accurately detecting and quantifying defects. Compared with conventional prediction algorithms, the proposed model can more effectively extract defect information from the infrared detection images, with the defect depth relative prediction error less than 1.5%. Thus, the proposed model was confirmed as an effective method and model for defect recognition and quantitative analysis using infrared thermal detection technology.