Researchers and engineers are presently focusing on efficient waste material utilization in the construction sector to reduce waste. Waste marble dust has been added to concrete to minimize pollution and landfills problems. Therefore, marble dust was utilized in concrete, and its prediction was made via an artificial intelligence approach to give an easier way to scholars for sustainable construction. Various blends of concrete having 40 mixes were made as partial substitutes for waste marble dust. The ultrasonic pulse velocity of waste marble dust concrete (WMDC) was compared to a control mix without marble dust. Additionally, this research used standalone (multiple-layer perceptron neural network) and supervised machine learning methods (Bagging, AdaBoost, and Random Forest) to predict the ultrasonic pulse velocity of waste marble dust concrete. The models’ performances were assessed using R2, RMSE, and MAE. Then, the models’ performances were validated using k-fold cross-validation. Furthermore, the effect of raw ingredients and their interactions using SHAP analysis was evaluated. The Random Forest model, with an R2 of 0.98, outperforms the MLPNN, Bagging, and AdaBoost models. Compared to all the other models (individual and ensemble), the Random Forest model with greater R2 and lower error (RMSE, MAE) has a superior performance. SHAP analysis revealed that marble dust content has a positive and direct influence on and relationship to the ultrasonic pulse velocity of concrete. Using machine learning to forecast concrete properties saves time, resources, and effort for scholars in the engineering sector.