Search · four archives
Search · four archives
23 papers · ranked by Valyu relevance
Il Memming Park, Jonathan W. Pillow
The efficient coding hypothesis, which proposes that neurons are optimized to maximize information about the environment, has provided a guiding theoretical framework for sensory and systems neuroscience. More recently, a theory known as the Bayesian Brain hypothesis has focused on the brain’s ability to integrate…
Tiberiu Tesileanu, Mary M Conte, John J Briguglio, Ann M Hermundstad + 4 more
Previously, in Hermundstad et al., 2014, we showed that when sampling is limiting, the efficient coding principle leads to a ‘variance is salience’ hypothesis, and that this hypothesis accounts for visual sensitivity to binary image statistics. Here, using extensive new psychophysical data and image analysis, we show…
Byron H. Price, Jeffrey P. Gavornik
While it is universally accepted that the brain makes predictions, there is little agreement about how this is accomplished and under which conditions. Accurate prediction requires neural circuits to learn and store spatiotemporal patterns observed in the natural environment, but it is not obvious how such information…
Ulisse Ferrari, Christophe Gardella, Olivier Marre, Thierry Mora
According to the theory of efficient coding, sensory systems are adapted to represent natural scenes with high fidelity and at minimal metabolic cost. Testing this hypothesis for sensory structures performing non-linear computations on high dimensional stimuli is still an open challenge. Here we develop a method to…
Veronika Koren, Alan J. Emanuel, Stefano Panzeri
How do biological neural systems efficiently encode, transform and propagate information between the sensory periphery and the sensory cortex about sensory features evolving at different time scales? Are these computations efficient in normative information processing terms? While previous work has suggested that…
Samuel Eckmann, Lukas Klimmasch, Bertram E. Shi, Jochen Triesch
The development of vision during the first months of life is an active process that comprises the learning of appropriate neural representations and the learning of accurate eye movements. While it has long been suspected that the two learning processes are coupled, there is still no widely accepted theoretical…
Miguel de Llanza Varona, Christopher L. Buckley, Beren Millidge
Rate-Distortion Theory Authors: ['Miguel de Llanza Varona' 'Christopher L. Buckley' 'Beren Millidge'] Abstract. Organisms have to keep track of the information in the environment that is relevant for adaptive behaviour. Transmitting information in an economical and efficient way becomes crucial for limitedresourced…
Arish Alreja, Ilya Nemenman, Christopher J. Rozell, Lyle J. Graham
The number of neurons in mammalian cortex varies by multiple orders of magnitude across different species. In contrast, the ratio of excitatory to inhibitory neurons (E:I ratio) varies in a much smaller range, from 3:1 to 9:1 and remains roughly constant for different sensory areas within a species. Despite this…
Wiktor Młynarski, Ann M. Hermundstad
The ability to adapt to changes in stimulus statistics is a hallmark of sensory systems. Here, we develop a theoretical framework that can account for the dynamics of adaptation from an information-processing perspective. We use this framework to optimize and analyze adaptive sensory codes, and we show that codes…
Jonathan Schaffner, Philippe N. Tobler, Todd A. Hare, Rafael Polania
It has generally been presumed that sensory information encoded by a nervous system should be as accurate as its biological limitations allow. However, perhaps counter intuitively, accurate representations of sensory signals do not necessarily maximize the organism’s chances of survival. To test this hypothesis, we…
Rahul Bhui, Samuel J. Gershman
The theory of decision by sampling (DbS) proposes that an attribute’s subjective value is its rank within a sample of attribute values retrieved from memory. This can account for instances of context dependence beyond the reach of classic theories which assume stable preferences. In this paper, we provide a normative…
Braden A. W. Brinkman, Alison I. Weber, Fred Rieke, Eric Shea-Brown + 1 more
'Jeff Beck'] Neural circuits reliably encode and transmit signals despite the presence of noise at multiple stages of processing. The efficient coding hypothesis, a guiding principle in computational neuroscience, suggests that a neuron or population of neurons allocates its limited range of responses as efficiently as…
Jesús Malo, Gholamreza Anbarjafari
Biological neural networks for color vision (also known as color appearance models) consist of a cascade of linear + nonlinear layers that modify the linear measurements at the retinal photo-receptors leading to an internal (nonlinear) representation of color that correlates with psychophysical experience. The basic…
Sarah E. Marzen, Simon DeDeo
In complex environments, there are costs to both ignorance and perception. An organism needs to track fitness-relevant information about its world, but the more information it tracks, the more resources it must devote to perception. As a first step towards a general understanding of this trade-off, we use a tool from…
Jesús Malo
Color Appearance Models are biological networks that consist of a cascade of linear+nonlinear layers that modify the linear measurements at the retinal photo-receptors leading to an internal (nonlinear) representation of color that correlates with psychophysical experience. The basic layers of these networks include…
Ismaila Salihou Adamou, Elsa Dupraz, Reza Asvadi, Tad Matsumoto
—This paper addresses the design of practical shortlength coding schemes for Distributed Hypothesis Testing (DHT). While most prior work on DHT has focused on informationtheoretic analyses—deriving bounds on Type-II error exponents via achievability schemes based on quantization and quantizebinning—the practical…
Yuta Nakahara, Toshiyasu Matsushima
In information theory, lossless compression of general data is based on an explicit assumption of a stochastic generative model on target data. However, in lossless image compression, the researchers have mainly focused on the coding procedure that outputs the coded sequence from the input image, and the assumption of…
Yuta Nakahara, Toshiyasu Matsushima, Jerry D. Gibson, Nithin Nagaraj + 1 more
'Kushal Shah'] In information theory, lossless compression of general data is based on an explicit assumption of a stochastic generative model on target data. However, in lossless image compression, researchers have mainly focused on the coding procedure that outputs the coded sequence from the input image, and the…
Ori Rottenstreich, Yuval Cassuto
Data compression is a well-studied (and well-solved) problem in the setup of long coding blocks. But important emerging applications need to compress data to memory words of small fixed widths. This new setup is the subject of this paper. In the problem we consider we have two sources with known discrete distributions…
Authors not listed
The exponentially growing body of scientific literature has made manual synthesis and hypothesis generation increasingly impractical, introducing an essential bottleneck in the scientific discovery pipeline. While large language models (LLMs) have unprecedented capability to process and summarize textual knowledge…
Carina Curto, Vladimir Itskov, Katherine M. Morrison, Z Roth + 1 more
'Judy L. Walker'] Shannon's seminal 1948 work gave rise to two distinct areas of research: information theory and mathematical coding theory. While information theory has had a strong influence on theoretical neuroscience, ideas from mathematical coding theory have received considerably less attention. Here we take a…
Authors not listed
Quantum state tomography has been widely used to reconstruct the quantum state of a system from a set of informationally-complete measurements. Obtaining enough information about, e.g., the wavefunction of a molecule allows its complete characterization. On the other hand, deep learning models for molecular property…
Miloje Rakočević
In some previous works (2018a,b; 2019, 2021a,b, 2022) we presented a new type of mirror symmetry, expressed in the set of protein amino acids; such a symmetry, that it simultaneously represents the semiotic essence of the genetic code. In this paper we provide new evidences that the genetic code represents the unity of…