Lane detection is one of the most basic and essential tasks for autonomous vehicles. Therefore, the fast and accurate recognition of lanes has become a hot topic in industry and academia. Deep learning based on a neural network is also a common method for lane detection. However, due to the huge computational burden of the neural network, its real-time performance is often difficult to meet the requirements in the fast-changing actual driving scenes. A lightweight network combining the Squeeze-and-Excitation block and the Self-Attention Distillation module is proposed in this paper, which is based on the existing deeplabv3plus network and specifically improves its real-time performance. After experimental verification, the proposed network achieved 97.49% accuracy and 60.0% MIOU at a run time of 8.7 ms, so the network structure achieves a good trade-off between real-time performance and accuracy.