13 papers · ranked by Valyu relevance
Yanbo Lian, Anthony N. Burkitt
Sparse coding, predictive coding and divisive normalization have each been found to be principles that underlie the function of neural circuits in many parts of the brain, supported by substantial experimental evidence. However, the connections between these related principles are still poorly understood. In this…
Michael Beyeler, Emily L. Rounds, Kristofor D. Carlson, Nikil Dutt + 2 more
'Jeffrey L. Krichmar' 'Aldo A. Faisal'] Supported by recent computational studies, there is increasing evidence that a wide range of neuronal responses can be understood as an emergent property of nonnegative sparse coding (NSC), an efficient population coding scheme based on dimensionality reduction and sparsity…
Yanbo Lian, Anthony N. Burkitt, Boris S. Gutkin
Sparse coding, predictive coding and divisive normalization have each been found to be principles that underlie the function of neural circuits in many parts of the brain, supported by substantial experimental evidence. However, the connections between these related principles are still poorly understood. Sparse coding…
Yanbo Lian, Anthony N. Burkitt
Experimental studies of grid cells in the Medial Entorhinal Cortex (MEC) have shown that they are selective to an array of spatial locations in the environment that form a hexagonal grid. However, place cells in the hippocampus are only selective to a single-location of the environment while granule cells in the…
Yuwei Cui, Subutai Ahmad, Jeff Hawkins
Hierarchical temporal memory (HTM) provides a theoretical framework that models several key computational principles of the neocortex. In this paper, we analyze an important component of HTM, the HTM spatial pooler (SP). The SP models how neurons learn feedforward connections and form efficient representations of the…
Damien Drix, Verena V. Hafner, Michael Schmuker
Cortical neurons are silent most of the time. This sparse activity is energy efficient, and the resulting neural code has favourable properties for associative learning. Most neural models of sparse coding use some form of homeostasis to ensure that each neuron fires infrequently. But homeostatic plasticity acting on a…
Eva L Dyer, Ueli Rutishauser, Richard G Baraniuk
Degeneracy is a ubiquitous feature of computation and coding in biological systems. Degenerate codes-codes in which multiple code words have the same meaning or interpretation-arise in a wide range of biological processes, from the many-to-one mapping of codons to amino acids to the numerous instances of degenerate…
Michael Beyeler, Emily Rounds, Kristofor D. Carlson, Nikil Dutt + 1 more
Supported by recent computational studies, sparse coding and dimensionality reduction are emerging as a ubiquitous coding strategy across brain regions and modalities, allowing neurons to achieve nonnegative sparse coding (NSC) by efficiently encoding high-dimensional stimulus spaces using a sparse and parts-based…
Jonathan J. Hunt, Peter Dayan, Geoffrey J. Goodhill, Matthias Bethge
Receptive fields acquired through unsupervised learning of sparse representations of natural scenes have similar properties to primary visual cortex (V1) simple cell receptive fields. However, what drives in vivo development of receptive fields remains controversial. The strongest evidence for the importance of sensory…
Andrew Ligeralde, Michael R. DeWeese
It is well known that sparse coding models trained on natural images learn basis functions whose shapes resemble the receptive fields (RFs) of simple cells in the primary visual cortex (V1). However, few studies have considered how these basis functions develop during training. In particular, it is unclear whether…
Eric McVoy Dodds, Michael Robert DeWeese
Sparse coding models of natural images and sounds have been able to predict several response properties of neurons in the visual and auditory systems. While the success of these models suggests that the structure they capture is universal across domains to some degree, it is not yet clear which aspects of this…
Jianing V. Shi, Jim Wielaard, R. Theodore Smith, Paul Sajda
Sparse coding has been posited as an efficient information processing strategy employed by sensory systems, particularly visual cortex. Substantial theoretical and experimental work has focused on the issue of sparse encoding, namely how the early visual system maps the scene into a sparse representation. In this paper…
S. Amin Moosavi, Antonia Pastor, Alfredo G. Ornelas, Elaine Tring + 1 more
Sparse coding enables cortical populations to represent sensory inputs efficiently, yet its temporal dynamics remain poorly understood. Consistent with theoretical predictions, we show that stimulus onset triggers broad cortical activation, initially reducing sparseness and increasing mutual information. Subsequently…