Spectral technology is a scientific method used to study and analyze substances. In recent years, the role of spectral technology in the non-destructive testing (NDT) of fruits has become increasingly important, and it is expected that its application in the NDT of fruits will be promoted in the coming years. However, there are still challenges in terms of dataset collection methods. This article aims to enhance the effectiveness of spectral technology in NDT of citrus and other fruits and to apply this technology in orchard environments. Firstly, the principles of spectral imaging systems and chemometric methods in spectral analysis are summarized. In addition, while collecting fruit samples, selecting an experimental environment is crucial for the study of maturity classification and pest detection. Subsequently, this article elaborates on the methods for selecting regions of interest (ROIs) for fruits in this field, considering both quantitative and qualitative perspectives. Finally, the impact of sample size and feature size selection on the experimental process is discussed, and the advantages and limitations of the current research are analyzed. Therefore, future research should focus on addressing the challenges of spectroscopy techniques in the non-destructive inspection of citrus and other fruits to improve the accuracy and stability of the inspection process. At the same time, achieving the collection of spectral data of citrus samples in orchard environments, efficiently selecting regions of interest, scientifically selecting sample and feature quantities, and optimizing the entire dataset collection process are critical future research directions. Such efforts will help to improve the application efficiency of spectral technology in the fruit industry and provide broad opportunities for further research.