Because of its unique characteristics of small specific gravity, high strength, and corrosion resistance, the carbon fiber sucker rod has been widely used in petroleum production. However, there is still a lack of corresponding online testing methods to detect its integrity during the process of manufacturing. Ultrasonic nondestructive testing has become one of the most accepted methods for inspection of homogeneous and fixed-thickness composites, or layered and fixed-interface-shape composites, but a carbon fiber sucker rod with multi-layered structures and irregular interlayer interfaces increases the difficulty of testing. In this paper, a novel defect detection method based on multi-sensor information fusion and a deep belief network (DBN) model was proposed to identify online its defects. A water-immersed ultrasonic array with 32 ultrasonic probes was designed to realize the online and full-coverage scanning of carbon fiber rods in radial and axial positions. Then, a multi-sensor information fusion method was proposed to integrate amplitudes and times-of-flight of the received ultrasonic pulse-echo signals with the spatial angle information of each probe into defect images with obvious defects including small cracks, transverse cracks, holes, and chapped cracks. Three geometric features and two texture features from the defect images characterizing the four types of defects were extracted. Finally, a DBN-based defect identification model was constructed and trained to identify the four types of defects of the carbon fiber rods. The testing results showed that the defect identification accuracy of the proposed method was 95.11%.