CUED Publications database

Entropy bounds on abelian groups and the ruzsa divergence

Madiman, M and Kontoyiannis, I (2016) Entropy bounds on abelian groups and the ruzsa divergence. IEEE Transactions on Information Theory, 64. pp. 77-92. ISSN 0018-9448

Full text not available from this repository.


© 2016 IEEE. Over the past few years, a family of interesting new inequalities for the entropies of sums and differences of random variables has been developed by Ruzsa, Tao, and others, motivated by analogous results in additive combinatorics. This paper extends these earlier results to the case of random variables taking values in Rnor, more generally, in arbitrary locally compact and Polish abelian groups. We isolate and study a key quantity, the Ruzsa divergence between two probability distributions, and we show that its properties can be used to extend the earlier inequalities to the present general setting. The new results established include several variations on the theme that the entropies of the sum and the difference of two independent random variables severely constrain each other. Although the setting is quite general, the results are already of interest (and new) for random vectors in Rn. In that special case, we discuss quantitative bounds for the stability of the equality conditions in the entropy power inequality, a reverse entropy power inequality for log-concave random vectors, an information-theoretic analog of the Rogers-Shephard inequality for convex bodies, and consequences of some of our results to determinant inequalities for sums of positive-definite matrices. Moreover, by considering various multiplicative subgroups of the complex plane, one obtains new inequalities for the differential entropies of products and ratios of nonzero, complex-valued random variables.

Item Type: Article
Uncontrolled Keywords: Abelian groups additive combinatorics entropy inequalities entropy Haar measure log-concave Rogers-Shephard inequality sumset bounds
Divisions: Div F > Signal Processing and Communications
Depositing User: Cron Job
Date Deposited: 08 Jan 2018 20:12
Last Modified: 27 Oct 2020 05:21
DOI: 10.1109/TIT.2016.2620470