In order to solve the problem of large image noise and unremarkable features caused by factors such as fluctuations in the power of a light source during the terahertz image acquisition of wheat, this paper proposes a THz image-denoising model called G-RRDB. Firstly, a module called Ghost-LKA is proposed by combining a large kernel convolutional attention mechanism module with a Ghost convolutional structure, which improves the characteristics of the network to acquire a global sensory field. Secondly, by integrating a spatial attention mechanism with channel attention, an attention module called DAB is proposed to enhance the network’s attention to important features. Thirdly, the Ghost-LKA module and DAB module are combined with the baseline model, thus proposing the dense residual denoising network G-RRDB. Compared with traditional denoising networks, both the PSNR and SSIM are improved. The prediction accuracy of G-RRDB is verified through the classification of the VGG16 network, achieving a rate of 92.8%, which represents an improvement of 1.7% and 0.2% compared to the denoised images obtained from the baseline model and the combined baseline model with the DAB module, respectively. The experimental results demonstrate that G-RRDB, a THz image-denoising model based on dense residual structure for moldy wheat, exhibits excellent denoising performance.