With current Near-infrared (NIR) image colorization methods, the color and details of the colorized images are not well restored. Thus, in this paper, we propose an unsupervised color feature control SE attention StyleGAN (CF-StyleGAN) method for the NIR image colorization task. The proposed method is based on histogram LAB color and brightness feature extraction, which solves the problem whereby the color and brightness of the results do not match the actual situation. The proposed Squeeze-and-Excitation-based StyleGAN (SE-SGAN) method, which introduces a channel attention mechanism based on StyleGAN and utilizes both standard deviation adaptive normalization and the Mish activation function in the synthesis network, can improve the quality of the output image. The proposed method was evaluated experimentally on the KAIST dataset. We found that the proposed CF-StyleGAN outperformed existing methods and achieved state-of-the-art NIR image colorization results. Experimental results show that the peak signal-to-noise ratio (PSNR) and structural similarity (SSIM) values of the colorized images were 27.15 and 0.83, respectively.