24 papers · ranked by Valyu relevance
Franklin Leong, Babak Rahmani, Demetri Psaltis, Christophe Moser + 1 more
A fundamental challenge in neuroengineering is determining a proper input to a sensory system that yields the desired functional output. In neuroprosthetics, this process is known as sensory encoding, and it holds a crucial role in prosthetic devices restoring sensory perception in individuals with disabilities. For…
Ye Chen, Peter Beech, Ziwei Yin, Shanshan Jia + 3 more
Understanding the computational mechanisms that underlie the encoding and decoding of environmental stimuli is a paramount investigation within the domain of neuroscience. Central to this pursuit is the exploration of how the brain represents visual information across its hierarchical architecture. A prominent…
Tijl Grootswagers, Amanda K. Robinson, Sophia M. Shatek, Thomas A Carlson
The basic computations performed in the human early visual cortex are the foundation for visual perception. While we know a lot about these computations from work in non-human animals, a key missing piece is how the coding of visual features relates to our perceptual experience. To investigate visual feature coding…
Tijl Grootswagers, Amanda K. Robinson, Sophia M. Shatek, Thomas A. Carlson + 1 more
'Thomas A. Carlson' 'Daniele Marinazzo'] The basic computations performed in the human early visual cortex are the foundation for visual perception. While we know a lot about these computations, a key missing piece is how the coding of visual features relates to our perception of the environment. To investigate visual…
Ehud Ahissar, Amos Arieli
During natural viewing, the eyes are never still. Even during fixation, miniature movements of the eyes move the retinal image across tens of foveal photoreceptors. Most theories of vision implicitly assume that the visual system ignores these movements and somehow overcomes the resulting smearing. However, evidence…
Luciano Dyballa, Greg D. Field, Michael P. Stryker, Steven W. Zucker
We have created “encoding manifolds” to reveal the overall responses of a brain area to a variety of stimuli. Encoding manifolds organize response properties globally: each point on an encoding manifold is a neuron, and nearby neurons respond similarly to the stimulus ensemble in time. We previously found, using a…
Joris Vincent, Marianne Maertens, Guillermo Aguilar
A key question in perception research is how stimulus variations translate into perceptual magnitudes, that is, the perceptual encoding process. As experimenters, we cannot probe perceptual magnitudes directly, but infer the encoding process from responses obtained in a psychophysical experiment. The most prominent…
Shuxiao Ma, Linyuan Wang, Senbao Hou, Bin Yan
Recently, there has been a surge in the popularity of pretrained large language models (LLMs) (such as GPT-4), sweeping across the entire Natural Language Processing (NLP) and Computer Vision (CV) communities. These LLMs have demonstrated advanced multi-modal understanding capabilities and showcased strong performance…
Xing Gao, Dazhong Rong, Qinming He
Investigating the mapping between visual stimuli and neural responses in the visual cortex contributes to a deeper understanding of biological visual processing mechanisms. Most existing studies characterize this mapping by training models to directly encode visual stimuli into neural responses or decode neural…
Andreea Lazar, Liane Klein, Johanna Klon-Lipok, Mihály Bányai + 2 more
Natural scene responses in the primary visual cortex are modulated simultaneously by attention and by contextual signals about scene statistics stored across the connectivity of the visual processing hierarchy. We hypothesize that attentional and contextual top-down signals interact in V1, in a manner that primarily…
Duho Sihn, Sung-Phil Kim
Hierarchical structures constitute a wide array of brain areas, including the visual system. One of the important questions regarding visual hierarchical structures is to identify computational principles for assigning functions that represent the external world to hierarchical structures of the visual system. Given…
Li Zhaoping
Our brain recognizes only a tiny fraction of sensory input, due to an information processing bottleneck. This blinds us to most visual inputs. Since we are blind to this blindness, only a recent framework highlights this bottleneck by formulating vision as mainly looking and seeing. Looking selects a tiny fraction of…
J. Gerard Wolff
The SP theory of intelligence aims to simplify and integrate concepts in computing and cognition, with information compression as a unifying theme. This article is about how the SP theory may, with advantage, be applied to the understanding of natural vision and the development of computer vision. Potential benefits…
Anna Cattani, Gaute T. Einevoll, Stefano Panzeri
The phase-of-firing code is a neural coding scheme whereby neurons encode information using the time at which they fire spikes within a cycle of the ongoing oscillatory pattern of network activity. This coding scheme may allow neurons to use their temporal pattern of spikes to encode information that is not encoded in…
Authors not listed
Determining complete atomic structures directly from microscopy images remains a longstanding challenge in materials science. MicroscopyGPT is a vision-language model (VLM) that leverages multimodal generative pre-trained transformers to predict full atomic configurations including lattice parameters, element types…
Dale Purves, Yaniv Morgenstern, William T. Wojtach
A central puzzle in vision science is how perceptions that are routinely at odds with physical measurements of real world properties can arise from neural responses that nonetheless lead to effective behaviors. Here we argue that the solution depends on: (1) rejecting the assumption that the goal of vision is to…
Authors not listed
Predicting protein-ligand binding affinity from three-dimensional (3D) structural data is a central task in structure-based drug discovery, yet it remains challenging due to limited data availability, structural complexity, and the sparse nature of 3D molecular representations. In this study, we investigate the…
Authors not listed
This research presents a novel approach to obstacle detection during navigation using a combination of Convolutional Neural Networks (CNNs) and Long Short-Term Memory (LSTM) networks. The primary objective is to generate accurate image captions that describe the content of images, which is crucial for applications such…
Joseph S. Lappin, Herbert H. Bell
Visual perception involves spatially and temporally coordinated variations in diverse physical systems: environmental surfaces and symbols, optical images, electro-chemical activity in neural networks, muscles, and bodily movements-each with a distinctly different material structure and energy. The fundamental problem…
Maria M. Del Viva, Giovanni Punzi, Steven K. Shevell, Samuel G. Solomon
'Samuel G. Solomon'] The visual system is able to recognize a scene based on a sketch made of very simple features. This ability is likely crucial for survival, when fast image recognition is necessary, and it is believed that a primal sketch is extracted very early in the visual processing. Such highly simplified…
Murat Cihan Sorkun, Dajt Mullaj, J. M. Vianney A. Koelman, Süleyman Er
Visualizing chemical spaces streamlines the analysis of molecular datasets by reducing the information to human perception level, hence it forms an integral piece of molecular engineering, including chemical library design, high-throughput screening, diversity analysis, and outlier detection. We present here ChemPlot…
Aman Chawla
In this brief paper, the authors study the tuning curves of starburst amacrine cells (SACs) and introduce a quantity called the irresolution or ambiguity of a SAC. They show that the rate of data generated by a starburst amacrine cell is inversely proportional to its irresolution. This is done by providing bounds on…
Authors not listed
X-ray diffraction (XRD) is an immediate and powerful characterization technique that provides detailed information on the lattice structure and long-range order in crystalline materials. In recent decades, the quality and quantity of available crystal structure data has exploded, in large part due to the advent of…
Authors not listed
Machine olfaction—the artificial replication of the sense of smell—faces significant challenges due to the absence of large, standardized training datasets. Unlike vision, language, and audio models, which benefit from extensive corpora such as ImageNet, GLUE, and AudioSet, olfaction lacks scaled equivalents and…