Objective. Achieving high precision rapid serial visual presentation (RSVP) task often requires many electrode channels to obtain more information. However, the more channels may contain more redundant information and also lead to its limited practical applications. Therefore, it is necessary to reduce the number of channels to enhance the classification performance and users experience. Furthermore, cross-subject generalization has always been one of major challenges in electroencephalography channel reduction, especially in the RSVP paradigm. Most search-based channel selection method presented in the literature are single-objective methods, the classification accuracy (ACC) is usually chosen as the only criterion. Approach. In this article, the idea of multi-objective optimization was introduced into the RSVP channel selection to minimize two objectives: classification error and the number of channels. By combining a multi-objective evolutionary algorithm for solving large-scale sparse problems and hierarchical discriminant component analysis (HDCA), a novel channel selection method for RSVP was proposed. After that, the cross-subject generalization validation through the proposed channel selection method. Main results. The proposed method achieved an average ACC of 95.41% in a public dataset, which is 3.49% higher than HDCA. The ACC was increased by 2.73% and 2.52%, respectively. Besides, the cross-subject generalization models in channel selection, namely special-16 and special-32, on untrained subjects show that the classification performance is better than the Hoffmann empirical channels. Significance. The proposed channel selection method could reduce the calibration time in the experimental preparation phase and obtain a better accuracy, which is promising application in the RSVP scenario that requires low-density electrodes.