12 papers · ranked by Valyu relevance
Kai Qiao, Chi Zhang, Jian Chen, Linyuan Wang + 2 more
On basis of functional magnetic resonance imaging (fMRI), researchers are devoted to designing visual encoding models to predict the neuron activity of human in response to presented image stimuli and analyze inner mechanism of human visual cortices. Deep network structure composed of hierarchical processing layers…
Weijian Mai, Mu Nan, Yu Zhu, Jiahang Cao + 5 more
Visual encoding and decoding models act as gateways to understanding the neural mechanisms underlying human visual perception. Typically, visual encoding models that predict brain activity from stimuli and decoding models that reproduce stimuli from brain activity are treated as distinct tasks, requiring separate…
Xing Gao, Dazhong Rong, Qinming He
Investigating the mapping between visual stimuli and neural responses in the visual cortex contributes to a deeper understanding of biological visual processing mechanisms. Most existing studies characterize this mapping by training models to directly encode visual stimuli into neural responses or decode neural…
Zijin Gu, K. A. Jamison, Mert R. Sabuncu, Amy Kuceyeski
Measuring and modeling individual-level differences in brain responses to external stimuli, e.g. images, video or sound, is an area of increasing interest in neuroscience. Quantifying population heterogeneity in stimuli-response mapping may allow insight into variability in bottom-up neural systems that can in turn be…
Shuxiao Ma, Linyuan Wang, Bin Yan
Biological research has revealed that the verbal semantic information in the brain cortex, as an additional source, participates in nonverbal semantic tasks, such as visual encoding. However, previous visual encoding models did not incorporate verbal semantic information, contradicting this biological finding. This…
Shuxiao Ma, Linyuan Wang, Senbao Hou, Bin Yan
Recently, there has been a surge in the popularity of pretrained large language models (LLMs) (such as GPT-4), sweeping across the entire Natural Language Processing (NLP) and Computer Vision (CV) communities. These LLMs have demonstrated advanced multi-modal understanding capabilities and showcased strong performance…
Peter Beech, Shanshan Jia, Zhaofei Yu, Jian K. Liu
The visual pathway involves complex networks of cells and regions which contribute to the encoding and processing of visual information. While some aspects of visual perception are understood, there are still many unanswered questions regarding the exact mechanisms of visual encoding and the organization of visual…
Samuele Virgili
While a great deal is known about the way the retina processes simple stimuli, our understanding of how the retina processes natural stimuli is still limited. Here we highlight some of the challenges that remain to be addressed to understand retinal processing of natural stimuli and describe emerging research avenues…
Li Zhaoping
Our brain recognizes only a tiny fraction of sensory input, due to an information processing bottleneck. This blinds us to most visual inputs. Since we are blind to this blindness, only a recent framework highlights this bottleneck by formulating vision as mainly looking and seeing. Looking selects a tiny fraction of…
Debasis Mazumdar, Kuntal Ghosh, Soma Mitra, Late Kamales Bhaumik
The present paper aims to develop a mathematical model concerning the visual perception of spatial information. In vision research and cognitive science, it is usually conjectured that the processing of spatial information takes place in the mid-level vision as described by David Marr. It is a challenging problem in…
Jian Chen, Petra Isenberg, Robert S. Laramee, Tobias Isenberg + 3 more
'Michael Sedlmair' 'Torsten Moeller' 'Rui Li'] Abstract—We present and discuss the results of a qualitative analysis of visual representations from images. We labeled each image's essential stimuli, the removal of which would render a visualization uninterpretable. As a result, we derive a typology of 10 image-based…
Aman Chawla
In this brief paper, the authors study the tuning curves of starburst amacrine cells (SACs) and introduce a quantity called the irresolution or ambiguity of a SAC. They show that the rate of data generated by a starburst amacrine cell is inversely proportional to its irresolution. This is done by providing bounds on…