Aiming at the problems of single camera color measuring system, a method of 3D object color measurement based on convergent binocular stereo vision is proposed. By taking a pair of 2D images, an 3D image is reconstructed in a 3D point cloud model, in which color of each point is restored by fusing colors of corresponding point of 2D images. Based on color charts with 240 and 24 colors, a distinctive 11-term polynomial is trained to convert colors from image RGB to CIELAB. An experiment was conducted to test the proposed method. The results show that the color prediction accuracy for the proposed model was good enough.