CUED Publications database

Predictive coding and the slowness principle: an information-theoretic approach.

Creutzig, F and Sprekeler, H (2008) Predictive coding and the slowness principle: an information-theoretic approach. Neural Comput, 20. pp. 1026-1041. ISSN 0899-7667

Full text not available from this repository.

Abstract

Understanding the guiding principles of sensory coding strategies is a main goal in computational neuroscience. Among others, the principles of predictive coding and slowness appear to capture aspects of sensory processing. Predictive coding postulates that sensory systems are adapted to the structure of their input signals such that information about future inputs is encoded. Slow feature analysis (SFA) is a method for extracting slowly varying components from quickly varying input signals, thereby learning temporally invariant features. Here, we use the information bottleneck method to state an information-theoretic objective function for temporally local predictive coding. We then show that the linear case of SFA can be interpreted as a variant of predictive coding that maximizes the mutual information between the current output of the system and the input signal in the next time step. This demonstrates that the slowness principle and predictive coding are intimately related.

Item Type: Article
Uncontrolled Keywords: Action Potentials Afferent Pathways Animals Cerebral Cortex Computer Simulation Humans Linear Models Neural Networks (Computer) Neurons Sensation Signal Processing, Computer-Assisted Time Factors
Subjects: UNSPECIFIED
Divisions: Div F > Computational and Biological Learning
Depositing User: Cron Job
Date Deposited: 07 Mar 2014 11:25
Last Modified: 10 Mar 2014 16:39
DOI: 10.1162/neco.2008.01-07-455

Actions (login required)

View Item