In the high-stakes domain of precision manufacturing, Cubic Boron Nitride (CBN) inserts are pivotal for their hardness and durability. However, post-production surface defects on these inserts can compromise product integrity and performance. This paper proposes an automated detection and classification system using machine vision to scrutinize these surface defects. By integrating an optical bracket, a high-resolution industrial camera, precise lighting, and an advanced development board, the system employs digital image processing to ascertain and categorize imperfections on CBN inserts. The methodology initiates with a high-definition image capture by the imaging platform, tailored for CBN insert inspection. A suite of defect detection algorithms undergoes comparative analysis to discern their efficacy, emphasizing the impact of algorithm parameters and dataset diversity on detection precision. The most effective algorithm is then encapsulated into a versatile application, ensuring compatibility with various operating systems. Empirical verification of the system shows that the detection accuracy of multiple defect types exceeds 90%, and the tooth surface recognition efficiency significantly reaches three frames per second, with the front and side cutting surfaces of the tool in each frame. This breakthrough indicates a scalable, reliable solution for automatically detecting and classifying surface defects on CBN inserts, paving the way for enhanced quality control in automated, high-speed production lines.