Agriculture is the primary source of human survival, which provides the most basic living and survival conditions for human beings. As living standards continue to improve, people are also paying more attention to the quality and safety of agricultural products. Therefore, the detection of agricultural product quality is very necessary. In the past decades, the spectroscopy technique has been widely used because of its excellent results in agricultural quality detection. However, traditional spectral inspection methods cannot accurately describe the internal information of agricultural products. With the continuous research and development of optical properties, it has been found that the internal quality of an object can be better reflected by separating the properties of light, such as its absorption and scattering properties. In recent years, spatially resolved spectroscopy has been increasingly used in the field of agricultural product inspection due to its simple compositional structure, low-value cost, ease of operation, efficient detection speed, and outstanding ability to obtain information about agricultural products at different depths. It can also separate optical properties based on the transmission equation of optics, which allows for more accurate detection of the internal quality of agricultural products. This review focuses on the principles of spatially resolved spectroscopy, detection equipment, analytical methods, and specific applications in agricultural quality detection. Additionally, the optical properties methods and direct analysis methods of spatially resolved spectroscopy analysis methods are also reported in this paper.