In the paper, it is proposed to develop a machine learning based intelligent defect detection system for metal products. The common machine vision system has the surface (stain, shallow pit, shallow tumor, scratches, Edge defects, pattern defects) detection, or for the processing of the size, diameter, diameter, eccentricity, height, thickness and other parts of the non-contact numerical parameters of detection. Considering the quality of the work piece and the defects of the standard, so for the quality of customized testing requirements, the study is the development of machine vision and machine learning metal products defect detection system, mainly composed of three procedures: Image preprocessing, training procedures and testing procedures. The system architecture consists of three parts: (1) Image preprocessing: we first use the machine vision. OPENCV to carry out the image pre-processing part of the product before the detection. (2) Training procedures: The algorithm of the machine learning includes the convolution neural network (CNN), chunk-max pooling is used to train the program, and the generative adversarial network (GAN) based architecture is used to solve the problem of small datasets for surface defects. (3) Testing procedures：The Python language is used to write the program and implement the testing procedures with the GPU-Based embedded hardware In industries, collecting training dataset is usually costly and related methods are highly dataset-dependent. So most companies cannot provide Big-data to be analyzed or applied. By the experimental results, the recognition accuracy can be obviously improved as increasing data augmentation by GAN-Based samples maker. Manual inspection is labor intensive, costly and less in efficiency. Therefore, this study will contribute to technological innovation, industry, national development and other applications. (1) The use of intelligent machine learning technology will make the industry 4.0 technology more sophisticated. (2) It will make the development of equipment industry be better by the machine learning applications. (3) It will increase the economics and productivity of countries for the aging of the population by machine learning.