Passenger flow is an important benchmark for measuring tourism benefits, and accurate tourism passenger flow prediction is of great significance to the government and related tourism enterprises and can promote the sustainable development of China’s tourism industry. For daily passenger flow time series data, a passenger flow forecasting method based on convolutional neural network (CNN) and improved quantile regression long short-term memory network (QRLSTM), denoted as CNN-IQRLSTM, is proposed with reconstructed correlation features and in the form of sliding windows as inputs. First, four discrete variables such as whether the day is a weekend and holiday are created by time; then, a sliding window of width 42 is used to pass the passenger flow data into the network sequentially; finally, the loss function of the sparse Laplacian improved QRLSTM is introduced for passenger flow prediction, and the point prediction and interval prediction results under different quartiles are obtained. The application of quantile regression captures the overall picture of the data, enhances the robustness, fit, predictive power and nonlinear processing capability of neural networks, and fills the gap between quantile regression and neural network methods in the field of passenger flow prediction. CNN can effectively handle complex input data, and the improved nonlinear QR model can provide passenger flow quantile prediction information. The method is applied to the tourism traffic prediction of four 5A scenic spots in Jilin Province, and the effectiveness of the method is verified. The results show that the method proposed in this paper fits best in point prediction and has higher prediction accuracy. The MAPE of the Changbai Mountain dataset was 0.07, the MAPE of the puppet palace museum dataset was 0.05, the fit of the Sculpture Park dataset reached 93%, and the fit of the net moon lake dataset was as high as 99%. Meanwhile, the interval prediction results show that the method has a larger interval coverage as well as a smaller interval average width, which improves the prediction efficiency. In 95% of the interval predictions, the interval coverage of Changbai Mountain data is 99% and the interval average width is 0.49. It is a good reference value for the management of different scenic spots.