Bounds on Rényi and Shannon Entropies for Finite Mixtures of Multivariate Skew-Normal Distributions: Application to Swordfish (Xiphias gladius Linnaeus)

Abstract

Mixture models are in high demand for machine-learning analysis due to their computational tractability, and because they serve as a good approximation for continuous densities. Predominantly, entropy applications have been developed in the context of a mixture of normal densities. In this paper, we consider a novel class of skew-normal mixture models, whose components capture skewness due to their flexibility. We find upper and lower bounds for Shannon and Rényi entropies for this model. Using such a pair of bounds, a confidence interval for the approximate entropy value can be calculated. In addition, an asymptotic expression for Rényi entropy by Stirling's approximation is given, and upper and lower bounds are reported using multinomial coefficients and some properties and inequalities of L p metric spaces. Simulation studies are then applied to a swordfish (Xiphias gladius Linnaeus) length dataset.

Estimating Mixture Entropy with Pairwise Distances

“…This lower bound was previously proposed for Gaussian mixtures in [18] and in a more general context in [12]. BothĤ KDE , Equation (3), andĤ ELK , Equation (5), are computationally efficient, continuous and differentiable, and depend on component overlap, making them suitable for optimization.…”

Sampling Procedure for Establishing Criteria for Sea Urchin (Loxechinus albus) Proportion under the Legal Minimum Length of landings

“…In addition, the boxes' weight was highly influenced by the size structure of sea urchin stocks. Therefore, the proposed approach could lead to bias especially when natural stocks in Quellón are intensively fished [12] or size structures are highly shifted [25]. In the last case, a size structure analysis should be performed to ensure the validity of the proposed method in future applications.…”

An Information-Theoretic Measure for Balance Assessment in Comparative Clinical Studies

“…In practice, computation of the JSD using observational data can be difficult for continuous densities, especially mixture distributions [2]. Our approach relies on the binning of continuous variables (as is done with histograms).…”

“…Depending on the situation, however, each of these three approaches may lead to erroneous conclusions. Univariate descriptive statistics may not adequately capture complex distributions (e.g., those with multiple modes) [2]. Tests of association are heavily dependent on sample size, and thus can be as indicative of sample size as they are of imbalance.…”