Aiming at the problems of weak dynamic response and difficulty in diagnosis of early damage of rolling bearings, a diagnosis method for early damage of rolling bearings is proposed. Taking radial rolling bearings as the main research object, the load symmetric structure of deep groove ball bearings is analyzed. Based on the mechanical second-order system theory, the sensor monitoring structure is constructed. The generalized resonance principle is used to identify weak signals, and the fiber Bragg grating is used for signal sensing. The signal is obtained through the fiber Bragg grating high-speed demodulator. When a continuous periodic generalized resonance wave appears in the amplitude–frequency analysis of the signal, and there is a high-frequency resonance frequency, it can be proved that the bearing is faulty. The diagnosis method can effectively avoid the interference of low-frequency signals, the frequency spectrum is pure and there is no electromagnetic interference. It fully shows that the fiber Bragg grating sensor is suitable for the monitoring and diagnosis of the early weak fault of the bearing.