Bone analyses using mid-infrared spectroscopy are gaining popularity, especially with handheld spectrometers that enable on-site testing as long as the data quality meets standards. In order to diagnose Staphylococcus epidermidis in human bone grafts, this study was carried out to compare the effectiveness of the Agilent 4300 Handheld Fourier-transform infrared with the Perkin Elmer Spectrum 100 attenuated-total-reflectance infrared spectroscopy benchtop instrument. The study analyzed 40 non-infected and 10 infected human bone samples with Staphylococcus epidermidis, collecting reflectance data between 650 cm−1 and 4000 cm−1, with a spectral resolution of 2 cm−1 (Agilent 4300 Handheld) and 0.5 cm−1 (Perkin Elmer Spectrum 100). The acquired spectral information was used for spectral and unsupervised classification, such as a principal component analysis. Both methods yielded significant results when using the recommended settings and data analysis strategies, detecting a loss in bone quality due to the infection. MIR spectroscopy provides a valuable diagnostic tool when there is a tissue shortage and time is of the essence. However, it is essential to conduct further research with larger sample sizes to verify its pros and cons thoroughly.