Internal pore defects are inevitable during laser powder bed fusion (LPBF), which have a significant impact on the mechanical properties of the parts. Therefore, detecting pores and obtaining their morphology will contribute to the quality of LPBF parts. Currently, supervised models are used for defect image detection, which requires a large amount of LPBF sample data, image labeling, and computing power equipment during the training process, resulting in high detection costs. This study extensively collected LPBF sample data and proposed a method for pore defect classification by obtaining its morphological features while detecting pore defects in optical microscopy (OM) images under various conditions. Compared with other advanced models, the proposed method achieves better detection accuracy on pore defect datasets with limited data. In addition, quickly detecting pore defects in a large number of labeling ground truth images will also contribute to the development of deep learning. In terms of image segmentation, the average accuracy scores of this method in the test images exceed 85%. The research results indicate that the algorithm proposed in this paper is suitable for quickly and accurately identifying pore defects from optical microscopy images.