Atractylodis rhizoma (AR) is an herb and food source with great economic, medicinal, and ecological value. Atractylodes chinensis (DC.) Koidz. (AC) and Atractylodes lancea (Thunb.) DC. (AL) are its two botanical sources. The commercial fraud of AR adulterated with Atractylodes japonica Koidz. ex Kitam (AJ) frequently occurs in pursuit of higher profit. To quickly determine the content of adulteration in AC and AL powder, two spectroscopic techniques, near-infrared spectroscopy (NIRS) and hyperspectral imaging (HSI), were introduced. The partial least squares regression (PLSR) algorithm was selected for predictive modeling of AR adulteration levels. Preprocessing and feature variable extraction were used to optimize the prediction model. Then data and image feature fusions were developed to obtain the best predictive model. The results showed that if only single-spectral techniques were considered, NIRS was more suitable for both tasks than HSI techniques. In addition, by comparing the models built after the data fusion of NIRS and HSI with those built by the single spectrum, we found that the mid-level fusion strategy obtained the best models in both tasks. On this basis, combined with the color-texture features, the prediction ability of the model was further optimized. Among them, for the adulteration level prediction task of AC, the best strategy was combining MLF data (at CARS level) and color-texture features (C-TF), at which time the R2T, RMSET, R2P, and RMSEP were 99.85%, 1.25%, 98.61%, and 5.06%, respectively. For AL, the best approach was combining MLF data (at SPA level) and C-TF, with the highest R2T (99.92%) and R2P (99.00%), as well as the lowest RMSET (1.16%) and RMSEP (2.16%). Therefore, combining data and image features from NIRS and HSI is a potential strategy to predict the adulteration content quickly, non-destructively, and accurately.