Raman spectroscopy is one of the most common methods to characterize graphene-related 2D materials, providing information on a wide range of physical and chemical properties. Because of typical sample inhomogeneity, Raman spectra are acquired from several locations across a sample, and analysis is carried out on the averaged spectrum from all locations. This is then used to characterize the “quality” of the graphene produced, in particular the level of exfoliation for top-down manufactured materials. However, these have generally been developed using samples prepared with careful separation of unexfoliated materials. In this work we assess these metrics when applied to non-ideal samples, where unexfoliated graphite has been deliberately added to the exfoliated material. We demonstrate that previously published metrics, when applied to averaged spectra, do not allow the presence of this unexfoliated material to be reliably detected. Furthermore, when a sufficiently large number of spectra are acquired, it is found that by processing and classifying individual spectra, rather than the averaged spectrum, it is possible to identify the presence of this material in the sample, although quantification of the amount remains approximate. We therefore recommend this approach as a robust methodology for reliable characterization of mass-produced graphene-related 2D materials using confocal Raman spectroscopy.