This study conducts an extensive comparative analysis of computational intelligence approaches aimed at predicting the compressive strength (CS) of concrete, utilizing two non-destructive testing (NDT) methods: the rebound hammer (RH) and the ultrasonic pulse velocity (UPV) test. In the ensemble learning approach, the six most popular algorithms (Adaboost, CatBoost, gradient boosting tree (GBT), random forest (RF), stacking, and extreme gradient boosting (XGB)) have been used to develop the prediction models of CS of concrete based on NDT. The ML models have been developed using a total of 721 samples, of which 111 were cast in the laboratory, 134 were obtained from in-situ testing, and the other samples were gathered from the literature. Among the three categories of analytical models—RH models, UPV models, and combined RH and UPV models; seven, ten, and thirteen models have been used respectively. AdaBoost, CatBoost, GBT, RF, Stacking, and XGB models have been used to improve the accuracy and dependability of the analytical models. The RH-M5, UPV-M6, and C-M6 (combined UPV and RH model) models were found with highest performance level amongst all the analytical models. The MAPE value of XGB was observed to be 84.37%, 83.24%, 77.33%, 59.46%, and 81.08% lower than AdaBoost, CatBoost, GBT, RF, and stacking, respectively. The performance of XGB model has been found best than other soft computing techniques and existing traditional predictive models.