A novel enhancement method of global brightness modulation and local contrast enhancement combined with the improved fuzzy set theory is proposed for color image contrast enhancement. The proposed method consists of three stages. Firstly, putting forward nonlinear global brightness mapping model adjusts dynamic range of images for luminance componentVofHSVcolor space. Secondly, membership function is established in stages to adjust local contrast of image details nonlinearly based on fuzzy set theory. Finally, the enhanced images are transformed fromHSVcolor space intoRGBcolor space. The experiments further show that the proposed method has the shortest processing time, the highest AIC values, and the least NIQE values among the other four conventional methods. It has excellent effect, which can enhance the global brightness and local contrast, and advance visibility of low illumination images.