CUED Publications database

Concentration and relative entropy for compound poisson distributions

Madiman, M and Kontoyiannis, I (2005) Concentration and relative entropy for compound poisson distributions. In: UNSPECIFIED pp. 1833-1837..

Full text not available from this repository.

Abstract

Using a simple inequality about the relative entropy, its so-called "tensorization property," we give a simple proof of a functional inequality which is satisfied by any compound Poisson distribution. This functional inequality belongs to the class of modified logarithmic Sobolev inequalities. We use it to obtain measure concentration bounds for compound Poisson distributions under a variety of assumptions on their tail behavior. In particular, we show how the celebrated "Herbst argument" can be modified to yield sub-exponential concentration bounds. For example, suppose Z is a compound Poisson random variable with values on the nonnegative integers, and let f be a function such that |f(k+1)- f(k)| ≤ 1 for all k. Then, if the base distribution of Z does not have a finite moment-generating function but has finite moments up to some order L > 1, we show that the probability that f(Z) exceeds its mean by a positive amount t or more decays approximately like (const)·t-L, where the constant is explicitly identified. This appears to be one of the very first examples of concentration bounds with power-law decay.

Item Type: Conference or Workshop Item (UNSPECIFIED)
Subjects: UNSPECIFIED
Divisions: Div F > Signal Processing and Communications
Depositing User: Cron Job
Date Deposited: 08 Jan 2018 20:12
Last Modified: 18 Aug 2020 12:42
DOI: 10.1109/ISIT.2005.1523662