Source enumeration is an important procedure for radio direction-of-arrival finding in the multiple signal classification (MUSIC) algorithm. The most widely used source enumeration approaches are based on the eigenvalues themselves of the covariance matrix obtained from the received signal. However, they have shortcomings such as the imperfect accuracy even at a high signal-to-noise ratio (SNR), the poor performance at low SNR, and the limited detection number of sources. This paper proposestwo source enumeration approaches using the ratio of eigenvalue gaps and the threshold trained by a machine learning based clustering algorithm for gaps of normalized eigenvalues, respectively. In the first approach, a criterion formula derived with eigenvalue gaps is used to determine the number of sources, where the formula has maximum value. In the second approach, datasets of normalized eigenvalue gaps are generated for the machine learning based clustering algorithm and the optimal threshold for estimation of the number of sources are derived, which minimizes source enumeration error probability. Simulation results show that our proposed approaches are superior to the conventional approaches from both the estimation accuracy and numerical detectability extent points of view. The results demonstrate that the second proposed approach has the feasibility to improve source enumeration performance if appropriate learning datasets are sufficiently provided.

In electronic warfare, source enumeration and direction-of-arrival estimation are important. The source enumeration method based on eigenvalues of covariance matrix from received is one of the most used methods. However, there are some drawbacks such as accuracy less than 100 % at high SNR, poor performance at low SNR and reduction of maximum number of estimating sources. We suggested new method based on eigenvalues gaps, which is named AREG(Accumulated Ratio of Eigenvalues Gaps). Meanwhile, FGML(Fast Gridless Maximum Likelihood) which reconstructs the covariance matrix was suggested by Wu et al., and it improves performance of the existing source enumeration methods without modification of algorithms. In this paper, first, we combine AREG with FGML to improve the performance. Second, we compare the performance of source enumeration and direction-of-arrival estimation methods in Rayleigh fading. Third, we suggest new method named REG(Ratio of Eigenvalues Gaps) to reduce performance degradation in Rayleigh Fading environment of AREG.