The concept of weighted entropy takes into account values of different outcomes, i.e., makes entropy context-dependent, through the weight function. In this paper, we establish a number of simple inequalities for the weighted entropies (general as well as specific), mirroring similar bounds on standard (Shannon) entropies and related quantities. The required assumptions are written in terms of various expectations of the weight functions. Examples are weighted Ky Fan and weighted Hadamard inequalities involving determinants of positive-definite matrices, and weighted Cramér-Rao inequalities involving the weighted Fisher information matrix. The weighted Gibbs inequality and its consequencesThe definition and initial results on weighted entropy were introduced in [1,11]. The purpose was to introduce disparity between outcomes of the same probability: in the case of a standard entropy such outcomes contribute the same amount of information/uncertainty, which is appropriate in contextfree situations. However, imagine two equally rare medical conditions, occurring with probability p << 1, one of which carries a major health risk while the other is just a peculiarity. Formally, they provide the same amount of information − log p but the value of this information can be very different. The weight, or a weight function, was supposed to fulfill this task, at least to a certain extent. The initial results have been further extended and deepened in [24,7,14,23,25,31,15], and, more recently, in [6,26,2,22,27]. Certain applications emerged, see [8,13], along with a number of theoretical suggestions.The purpose of this note is to extend a number of inequalities, established previously for a standard (Shannon) entropy, to the case of the weighted entropy. We particularly mention Ky Fanand Hadamard-type inequalities from [3,9,20] which are related to (standard) Gaussian entropies. Extended inequalities for weighted entropies already found applications and further developments in [28,29,30]. Another kind of bounds, weighted Cramér-Rao inequalities, may be useful in statistics.An additional motivation for studying weighted entropy (WE) can be provided in the following questions. (I) What is the rate at which the WE is produced by a sample of a random process (and what could be an analog of the Shannon-McMillan-Breiman theorem)? (II) What would be an analog of Shannon's Second Coding theorem when an incorrect channel output causes a penalty but does not make the transmission session invalid? Properties of the WE established in the current paper could be helpful in this line of research.One of naturally emerging questions is about the form/structure of the weight function (WF). In this paper we focus on some simple inequalities (as suggested by the title). Our results hold for fairly 2010 Mathematics Subject Classification: 60A10, 60B05, 60C05
A version of the Widom-Rowlinson model is considered, where particles of q types coexist, subject to pairwise hard-core exclusions. For q ≤ 4, in the case of large equal fugacities, we give a complete description of the pure phase picture based on the theory of dominant ground states.
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.
customersupport@researchsolutions.com
10624 S. Eastern Ave., Ste. A-614
Henderson, NV 89052, USA
This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.
Copyright © 2024 scite LLC. All rights reserved.
Made with 💙 for researchers
Part of the Research Solutions Family.