Asphalt pavement ages and incurs various distresses due to natural and human factors. Thus, it is crucial to rapidly and accurately extract different types of pavement distress to effectively monitor road health status. In this study, we explored the feasibility of pavement distress identification using low-altitude unmanned aerial vehicle light detection and ranging (UAV LiDAR) and random forest classification (RFC) for a section of an asphalt road that is located in the suburb of Shihezi City in Xinjiang Province of China. After a spectral and spatial feature analysis of pavement distress, a total of 48 multidimensional and multiscale features were extracted based on the strength of the point cloud elevations and reflection intensities. Subsequently, we extracted the pavement distresses from the multifeature dataset by utilizing the RFC method. The overall accuracy of the distress identification was 92.3%, and the kappa coefficient was 0.902. When compared with the maximum likelihood classification (MLC) and support vector machine (SVM), the RFC had a higher accuracy, which confirms its robustness and applicability to multisample and high-dimensional data classification. Furthermore, the method achieved an overall accuracy of 95.86% with a validation dataset. This result indicates the validity and stability of our method, which highway maintenance agencies can use to evaluate road health conditions and implement maintenance.