The punching process of AHSS induces edge cracks in successive process, limiting the application of AHSS for vehicle bodies. Controlling and predicting edge quality is substantially difficult due to the large variation in edge quality, die wear induced by high strength, and the complex effect of phase distribution. To overcome this challenge, a quality prediction model that considers the variation of the entire edge should be developed. In this study, the image of the entire edge was analyzed to provide a comprehensive evaluation of its quality. Statistical features were extracted from the edge images to represent the edge quality of DP780, DP980, and MART1500 steels. Combined with punching monitoring signals, a prediction model for hole expansion ratio was developed under punch conditions of varying clearance, punch angle, and punch edge radius. It was found that the features of grayscale variation are affected by the punching conditions and are related to the double burnish and uneven burr, which degrades the edge quality. Prediction of HER was possible based on only edge image and monitoring signals, with the same performance as the prediction based solely on punching parameters and material properties. The prediction performance improved when using all the features.