Comparison of Information Criteria for Detection of Useful Signals in Noisy Environments

Abstract

This paper considers the appearance of indications of useful acoustic signals in the signal/noise mixture. Various information characteristics (information entropy, Jensen–Shannon divergence, spectral information divergence and statistical complexity) are investigated in the context of solving this problem. Both time and frequency domains are studied for the calculation of information entropy. The effectiveness of statistical complexity is shown in comparison with other information metrics for different signal-to-noise ratios. Two different approaches for statistical complexity calculations are also compared. In addition, analytical formulas for complexity and disequilibrium are obtained using entropy variation in the case of signal spectral distribution. The connection between the statistical complexity criterion and the Neyman–Pearson approach for hypothesis testing is discussed. The effectiveness of the proposed approach is shown for different types of acoustic signals and noise models, including colored noises, and different signal-to-noise ratios, especially when the estimation of additional noise characteristics is impossible.

Research on Wavelet Transform Modulus Maxima and OTSU in Edge Detection

“…Information entropy is used as a measure of uncertainty, that is, the probability of discrete random events occurring. Briefly , the more chaotic things are, the higher the information entropy, and conversely, the lower the information entropy [29,30,31,32,33,34].…”