The implementation of optical sensor technology to monitor the milk quality on dairy farms and milk processing plants would support the early detection of altering production processes. Basic visible and near-infrared spectroscopy is already widely used to measure the composition of agricultural and food products. However, to obtain maximal performance, the design of such optical sensors should be optimized with regard to the optical properties of the samples to be measured. Therefore, the aim of this study was to determine the visible and near-infrared bulk absorption coefficient, bulk scattering coefficient, and scattering anisotropy spectra for a diverse set of raw milk samples originating from individual cow milkings, representing the milk variability present on dairy farms. Accordingly, this database of bulk optical properties can be used in future simulation studies to efficiently optimize and validate the design of an optical milk quality sensor. In a next step of the current study, the relation between the obtained bulk optical properties and milk quality properties was analyzed in detail. The bulk absorption coefficient spectra were found to mainly contain information on the water, fat, and casein content, whereas the bulk scattering coefficient spectra were found to be primarily influenced by the quantity and the size of the fat globules. Moreover, a strong positive correlation (r ≥ 0.975) was found between the fat content in raw milk and the measured bulk scattering coefficients in the 1,300 to 1,400 nm wavelength range. Relative to the bulk scattering coefficient, the variability on the scattering anisotropy factor was found to be limited. This is because the milk scattering anisotropy is nearly independent of the fat globule and casein micelle quantity, while it is mainly determined by the size of the fat globules. As this study shows high correlations between the sample's bulk optical properties and the milk composition and fat globule size, a sensor that allows for robust separation between the absorption and scattering properties would enable accurate prediction of the raw milk quality parameters.