Wire electrical discharge machining (WEDM), widely used to fabricate micro and precision parts in manufacturing industry, is a nontraditional machining method using discharge energy which is transformed into thermal energy to efficiently remove materials. A great amount of research has been conducted based on pulse characteristics. However, the spark image-based approach has little research reported. This paper proposes a discharge spark image-based approach. A model is introduced to predict the discharge status using spark image features through a synchronous high-speed image and waveform acquisition system. First, the relationship between the spark image features (e.g., area, energy, energy density, distribution, etc.) and discharge status is explored by a set of experiments). Traditional methods have claimed that pulse waveform of “short” status is related to the status of non-machining while through our research, it is concluded that this is not always true by conducting experiments based on the spark images. Second, a deep learning model based on Convolution neural network (CNN) and Gated recurrent unit (GRU) is proposed to predict the discharge status. A time series of spark image features extracted by CNN form a 3D feature space is used to predict the discharge status through GRU. Moreover, a quantitative labeling method of machining state is proposed to improve the stability of the model. Due the effective features and the quantitative labeling method, the proposed approach achieves better predict result comparing with the single GRU model.