13 papers · ranked by Valyu relevance
Beren Millidge, Anil K. Seth, Christopher L. Buckley
Predictive coding offers a potentially unifying account of cortical function – postulating that the core function of the brain is to minimize prediction errors with respect to a generative model of the world. The theory is closely related to the Bayesian brain framework and, over the last two decades, has gained…
Beren Millidge, Alexander Tschantz, Anil K. Seth, Christopher L. Buckley
'Christopher L. Buckley'] Predictive coding is an influential theory of cortical function which posits that the principal computation the brain performs, which underlies both perception and learning, is the minimization of prediction errors. While motivated by high-level notions of variational inference, detailed…
Lucie Fontaine
—Complementary Learning Systems theory holds that intelligent agents need two learning systems. Semantic memory is encoded in the neocortex with dense, overlapping representations and acquires structured knowledge. Episodic memory is encoded in the hippocampus with sparse, pattern-separated representations and quickly…
Anthony Lin
We introduce a novel predictive coding framework for studying attachment theory. Building off an established model of attachment, the dynamic-maturational model (DMM), as well as the neuroanatomical Embodied Predictive Interoception Coding (EPIC) model of interoception and emotion, we not only elucidate how neural…
Linxing Preston Jiang, Rajesh P. N. Rao
Predictive coding is a unifying framework for understanding perception, action and neocortical organization. In predictive coding, dierent areas of the neocortex implement a hierarchical generative model of the world that is learned from sensory inputs. Cortical circuits are hypothesized to perform Bayesian inference…
Rajesh P. N. Rao, Vishwas Sathish, Linxing Preston Jiang, Matthew Bryan + 1 more
The phenomenal advances in large language models (LLMs) and other foundation models over the past few years have been based on optimizing large-scale transformer models on the surprisingly simple objective of minimizing next-token prediction loss, a form of predictive coding that is also the backbone of an increasingly…
Jared M. Salisbury, Stephanie E. Palmer
Almost all neural computations involve making predictions. Whether an organism is trying to catch prey, avoid predators, or simply move through a complex environment, the data it collects through its senses can guide its actions only to the extent that it can extract from these data information about the future state…
Antony W. N’Dri, William Gebhardt, Céline Teulière, Fleur Zeldenrust + 3 more
'Rajesh P. N. Rao' 'Jochen Triesch' 'Alexander G. Ororbia'] In this article, we review a class of neuro-mimetic computational models that we place under the label of spiking predictive coding. Specifically, we review the general framework of predictive processing in the context of neurons that emit discrete action…
Matin Hosseini, Anthony S. Maida
Bayesian predictive coding is a putative neuromorphic method for acquiring higherlevel neural representations to account for sensory input. Although originating in the neuroscience community, there are also efforts in the machine learning community to study these models. This paper reviews some of the more well known…
Stephanie E. Palmer, Olivier Marre, Michael J. Berry, William Bialek
Guiding behavior requires the brain to make predictions about future sensory inputs. Here we show that efficient predictive computation starts at the earliest stages of the visual system. We estimate how much information groups of retinal ganglion cells carry about the future state of their visual inputs, and show that…
David Calhas, Arlindo L. Oliveira
While biological vision systems rely heavily on feedback connections to iteratively refine perception, most artificial neural networks remain purely feedforward, processing input in a single static pass. In this work, we propose a predictive coding inspired feedback mechanism that introduces a recurrent loop from…
Nikolas McNeal, Jennifer T. Huang, Aniekan Umoren, Shuqi Dai + 3 more
'Roger B. Dannenberg' 'Richard Randall' 'Tai Sing Lee'] We explore the use of a neural network inspired by predictive coding for modeling human music perception. This network was developed based on the computational neuroscience theory of recurrent interactions in the hierarchical visual cortex. When trained with video…
Randall C. O’Reilly, Jacob Russin, Maryam Zolfaghar, John Rohrlich
We thank Dean Wyatte, Tom Hazy, Seth Herd, Kai Krueger, Tim Curran, David Sheinberg, Lew Harvey, Jessica Mollick, Will Chapman, Helene Devillez, and the rest of the CCN Lab for many helpful comments and suggestions. Supported by: ONR grants ONR N00014-19-1-2684 / N00014-18-1-2116, N00014-14-1-0670 / N00014-16-1-2128…