With the increasing number of classifications in bearing fault diagnosis, it is difficult to achieve accurate results based on the original signal or time-frequency features calculated by the time-frequency analysis method, such as the continuous wavelet transform. Aiming at this issue, a time-frequency joint metric features extraction technique named non-negative wavelet matrix factorization (NWMF) is developed to apply in bearing fault intelligent classification. In the proposed technique, the NWMF is used to calculate bearing fault-related internal core information from the original time-frequency spectrum, as a result, the time-frequency characteristic dimension decrease, and the computational efficiency increase. In addition, a novel convolutional neural network model is developed to identify locations and sizes of fault bearing based on the calculated internal core information. For verifying the effectiveness of the proposed method, the types of bearing faults in the experiments are set up to fifteen, the results and comparative analysis reveal that the feasibility and superiority of the proposed method are much better than the other traditional machine learning methods and original deep learning methods, such as the support vector machine, random forest and residual neural network.