Egypt has been fighting the issue of ensuring road safety‚ reducing accidents‚ preserving the lives of citizens since its inception. For these reasons‚ precisely identifying the road condition‚ followed by effective and timely maintenance and rehabilitation measures‚ leads to an increase in the road network's safety level and lifespan. This paper presents a multi-input deep learning framework that combines BiLSTM and Depthwise separable convolution to work in parallel for automatic recognition of road surface quality and different road anomalies. Furthermore, we performed an investigation to compare deep networks approaches against other traditional approaches using real-time data sensed and collected from the Egyptian road network. The proposed deep model has achieved an average accuracy of 93.1%‚ which is superior compared to other evaluated approaches. Finally, we utilized the proposed model to estimate a road quality index in the Egyptian cities.