The recognition of aircraft wake vortex can provide an indicator of early warning for civil aviation transportation safety. In this paper, several wake vortex recognition models based on deep learning and traditional machine learning were presented. Nonetheless, these models are not completely suitable owing to their dependence on the visualization of LiDAR data that yields the information loss of in reconstructing the behavior patterns of wake vortex. To tackle this problem, we proposed a lightweight deep learning framework to recognize aircraft wake vortex in the wind field of Shenzhen Baoan Airport’s arrival and departure routes. The nature of the introduced model is geared towards three aspects. First, the dilation patch embedding module is used as the input representation of the framework, attaining additional rich semantics information over long distances while maintaining parameters. Second, we combined a separable convolution module with a hybrid attention mechanism, increasing the model’s attention to the space position of wake vortex core. Third, environmental factors that affect the vortex behavior of the aircraft’s wake were encoded into the model. Experiments were conducted on a Doppler LiDAR acquisition dataset to validate the effectiveness of the proposed model. The results show that the proposed network has an accuracy of 0.9963 and a recognition speed at 100 frames per second was achieved on an experimental device with 0.51 M parameters.