“…So, we observe that the aforementioned nonnegativity of JSD arises from the convexity of the Shannon entropy functional S. Different properties and generalizations of JSD have been discussed and employed in past years [17,41,42].…”
Section: Jensen-shannon and Kullback-leibler Divergencesmentioning
“…So, we observe that the aforementioned nonnegativity of JSD arises from the convexity of the Shannon entropy functional S. Different properties and generalizations of JSD have been discussed and employed in past years [17,41,42].…”
Section: Jensen-shannon and Kullback-leibler Divergencesmentioning
“…A reviewer pointed out that I c (pkq) is for c = 1 equal (up to a factor 2) to the Shannon-Jensen divergence [44,26] I s ðpkqÞ ¼ 1 2 ½Iðpkp þ qÞ þ Iðqkp þ qÞ þ 2 log 2. The Shannon-Jensen divergence is a symmetrized version of the Kullback-Leibler information divergence.…”
Section: The Pólya Information Divergencementioning
“…They determine the sharpness and spreading out of its probability distribution, independent of its actual value ofx. H (P) is written as a sum of functions of the individual components of P (for details see [4] and [15])…”
Besides the well-known Shannon entropy, there is a set of Shannon-like entropies which have applications in statistical and quantum physics. These entropies are functions of certain parameters and converge toward Shannon entropy when these parameters approach the value 1. We describe brie®y the most important Shannon-like entropies and present their graphical representations. Their graphs look almost identical, though by superimposing them it appears that they are distinct and characteristic of each Shannon-like entropy. We try to formulate the alternative entropic uncertainty relations by means of the Shannon-like entropies and show that all of them equally well express the uncertainty principle of quantum physics.
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.