Tight bounds for augmented KL divergence in terms of augmented total variation distance

Abstract

We provide optimal variational upper and lower bounds for the augmented Kullback-Leibler divergence in terms of the augmented total variation distance between two probability measures defined on two Euclidean spaces having different dimensions.