With the rapid increase of ageing infrastructures worldwide, effective and robust inspection techniques are highly demanding to evaluate structural conditions and residual lifetime. The damages on structural surfaces, for example, spalling, crack, rebar buckling and exposure, are important indicators to assess the structural condition. In fact, several state-of-the-art automated inspection techniques using these indicators have been developed to reduce human-conducted onsite inspection activities. However, the efficiency of these techniques is still required to be improved in terms of accuracy and computational cost. In this study, a vision-based crack diagnosis method is developed using deep convolutional neural network (DCNN) and enhanced chicken swarm algorithm (ECSA). A DCNN model is designed with a deep architecture, consisting of six convolutional layers, two pooling layers and three fully connected layers. To enhance the generalisation capacity of trained model, ECSA is introduced to optimize meta-parameters of the DCNN model. The model is trained and tested using image patches cropped from raw images obtained from damaged concrete samples. Finally, a comparative study on different crack detection techniques is conducted to evaluate performance of the proposed method via a group of statistical evaluation indicators.