CUED Publications database

Mutual information, synergy and some curious phenomena for simple channels

Kontoyiannis, I and Lucena, B (2005) Mutual information, synergy and some curious phenomena for simple channels. In: UNSPECIFIED pp. 1651-1655..

Full text not available from this repository.


Suppose we are allowed to observe two equally noisy versions of some signal X, where the level of the noise is fixed. We are given a choice: We can either observe two independent noisy versions of X, or two correlated ones. We show that, contrary to what classical statistical intuition suggests, it is often the case that correlated data is more valuable than independent data. We investigate this phenomenon in a variety of contexts, we give numerous examples for standard families of channels, and we present general sufficient conditions for deciding this dilemma. One of these conditions draws an interesting connection with the information-theoretic notion of "synergy," which has received a lot of attention in the neuroscience literature recently.

Item Type: Conference or Workshop Item (UNSPECIFIED)
Divisions: Div F > Signal Processing and Communications
Depositing User: Cron Job
Date Deposited: 08 Jan 2018 20:12
Last Modified: 27 Oct 2020 07:13
DOI: 10.1109/ISIT.2005.1523625