21 papers · ranked by Valyu relevance
Xing Gao, Dazhong Rong, Qinming He
Investigating the mapping between visual stimuli and neural responses in the visual cortex contributes to a deeper understanding of biological visual processing mechanisms. Most existing studies characterize this mapping by training models to directly encode visual stimuli into neural responses or decode neural…
Svenja Klinkowski, Anna Seewald, Björn Fath, Vanessa Kasties + 7 more
Neocortical memories are assumed to rely on slow systems consolidation through hippocampal offline reactivation. However, recent studies show rapid neocortical integration of new memories for information associated with prior knowledge. Testing the limits of rapid neocortical learning, we tracked memory formation…
Wiete Fehner, Morgan Fogarty, Jerry Tang, Dana Wilhelm + 6 more
Understanding how the brain represents meaning in real-world contexts is essential for both fundamental neuroscience and clinical applications. Brain encoding and decoding models from naturalistic stimuli provide a powerful window into semantic representations. Yet, existing approaches rely on a constrained scanning…
Ronan T. O’Shea, Xue-Xin Wei, Nicholas J. Priebe
Natural environments contain behaviorally relevant information along many stimulus dimensions, each of which sensory systems must encode in order to guide behaviors. For example, the mammalian visual cortex encodes features of visual scenes such as spatial information related to object identity and temporal information…
Kim Marriott, Matthew Butler, Leona Holloway, B. Jolley + 3 more
—Tactile graphics are widely used to present maps and statistical diagrams to blind and low vision (BLV) people, with accessibility guidelines recommending their use for graphics where spatial relationships are important. Their use is expected to grow with the advent of commodity refreshable tactile displays. However…
Yue Wang, Peter Brunner, Jon T. Willie, Runnan Cao + 2 more
Object recognition requires integrated processing that extends beyond the visual cortex, incorporating semantic and memory-related processes. However, it remains unclear how different attributes, such as visual, semantic, and memorability features, are encoded and interact during perception. Here, we recorded…
Yihong Wang, Jianbiao Hu, Shuang Xu, Xuying Xu + 2 more
Head direction (HD) cells can fire selectively as a function of the animal’s head azimuth direction and form an internal compass for navigation. They were found in the mammalian limbic system including the dorsal presubiculum and entorhinal cortex. The underlying network updates its directional estimate in a…
Fei, Teng, Ravishankar, Srinivas + 12 more
1 Department of Cognitive Science, 2 Halıcıoglu Data Science Institute (HDSI), ˘ 3 Department of Computer Science and Engineering, 4 Shu Chien - Gene Lay Department of Bioengineering, University of California, San Diego (UCSD) 5 Neuroscience Technology Research Group, Human Informatics and Interaction Research…
Enea J. Weber, Fred W. Mast
Eye movements during visual mental imagery resemble those made during prior perception. Across two experiments, we investigated whether eye movements during imagery reflect a part-by-part generation of mental images, by comparing gaze patterns during mental imagery to those during part-based viewing (using a…
Jingyi Feng, Xiang Feng
—Understanding the encoding and decoding mechanisms of dynamic neural responses to different visual stimuli is an important topic in exploring how the brain represents visual information. Currently, hierarchically deep neural networks (DNNs) have played a significant role as tools for mining the core features of…
Xin Wang, Zhuangzhi Gao, Hongyi Qin, Zhongli Wu + 2 more
Understanding the neural mechanisms underlying visual computation has long been a central challenge in neuroscience. Recent alignment based approaches have improved the accuracy of decoding visual stimuli from brain activity, yet they provide limited insight into the neural computations that give rise to these…
Niklas Müller, Hongye Chen, Sofie Wahlberg, H. Steven Scholte + 2 more
Retinotopic tuning of neural populations is a key organizing principle of human visual cortex. However, state-of-the-art models that predict neural recordings based on task-optimized Convolutional Neural Networks (CNNs) do not take this retinotopic organization into account. Furthermore, while retinotopic tuning in…
Daniel Anthes, Sushrut Thorat, Anna Mitola, Paolo Papale + 2 more
In studying primate vision, a large body of work focuses on the first feedforward sweep. During this initial time window, information is thought to pass through ventral stream regions in a stage-like fashion in an effort to extract high-level information from the retinal input. Consequently, electrophysiological…
Loris Naspi, Şafak Erener, Simon W. Davis, Roberto Cabeza
Visual false memory refers to our tendency to falsely recognize novel stimuli that are visually similar to seen stimuli. Visual false memory also occurs when stimuli are meaningful, suggesting that semantic information interferes with the encoding of visual details. However, the neural mechanisms of this semantic…
Yaoda Xu, Benjamin Swinchoski, JohnMark Taylor, Marvin Chun
Two defining visual features of a real-world object are its shape and color. While previous fMRI pattern decoding studies showed that these features are represented in a largely orthogonal and independent manner in the human occipitotemporal cortex (OTC) during visual perception, how they are coded together in visual…
Yang Du, Siyuan Dai, Yonghao Song, Paul M. Thompson + 2 more
Neural visual decoding is a central problem in brain–computer interface research, aiming to reconstruct human visual perception and to elucidate the structure of neural representations. However, existing approaches overlook a fundamental granularity mismatch between human and machine vision, where deep vision models…
Joost de Jong, Mark Siertsema, Cemre Baykan, Elkan Akyürek
Humans and non-human animals adaptively boost their encoding speed when they expect limited sensory exposure time, so that they can capture essential information before it is gone. However, it is unclear how the brain implements this crucial adaptation. Using multivariate pattern analysis of human EEG data, we found…
Maëliss Vivion, Fabien Mathy, Alessandro Guida, Lydiane Mondot + 1 more
Spatialization in working memory refers to the spatial coding of non-spatial information along a mental horizontal line when encoding verbal material. This phenomenon is thought to support working memory by facilitating order encoding. Although it has been observed for both visually and auditorily presented stimuli, no…
Authors not listed
Large Language Models have demonstrated impressive capabilities in natural language understanding and processing. However, as AI and LLMs continue to evolve, their ability to accurately and efficiently interpret data from scientific figures and plots remains obscure. In this study, we test and evaluate the ability of…
Authors not listed
Machine olfaction—the artificial replication of the sense of smell—faces significant challenges due to the absence of large, standardized training datasets. Unlike vision, language, and audio models, which benefit from extensive corpora such as ImageNet, GLUE, and AudioSet, olfaction lacks scaled equivalents and…
Authors not listed
Conventional molecular graphs often are unable to reliably encode stereochemistry, especially for symmetric molecules, non-tetrahedral centers, and transition states. To overcome this, we present StereoMolGraph, an open source Python library implementing a stereochemistry-aware graph representation for molecules and…