The spice paprika (Capsicum annuum and frutescens) is used in a wide variety of cooking methods as well as seasonings and sauces. The oil, paprika oleoresin, is a valuable product; however, once removed from paprika, the remaining spent product can be used to adulterate paprika. Near-infrared (NIR) and Fourier transform infrared (FTIR) were the platforms selected for the development of methods to detect paprika adulteration in conjunction with chemometrics. Orthogonal partial least squares discriminant analysis (OPLS-DA), a supervised technique, was used to develop the chemometric models, and the measurement of fit (R2) and measurement of prediction (Q2) values were 0.853 and 0.819, respectively, for the NIR method and 0.943 and 0.898 respectively for the FTIR method. An external validation set was tested against the model, and a receiver operating curve (ROC) was created. The area under the curve (AUC) for both methods was highly accurate at 0.951 (NIR) and 0.907 (FTIR). The levels of adulteration with 100% correct classification were 50–90% (NIR) and 40–90% (FTIR). Sudan I dye is a commonly used adulterant in paprika; however, in this study it was found that this dye had no effect on the outcome of the result for spent material adulteration.