15 papers · ranked by Valyu relevance
Wasserman, Navve, Cosarinsky, Matias + 10 more
Understanding how the human brain represents visual concepts, and in which brain regions these representations are encoded, remains a long-standing challenge. Decades of work have advanced our understanding of visual representations, yet brain signals remain large and complex, and the space of possible visual concepts…
Xuelin Qian, Yikai Wang, Yanwei Fu, Xiangyang Xue + 1 more
The connection between brain activity and corresponding visual stimuli is crucial in comprehending the human brain. While deep generative models have exhibited advancement in recovering brain recordings by generating images conditioned on fMRI signals, accomplishing high-quality generation with consistent semantics…
Sean Paulsen, Lloyd May, Michael A. Casey
—Stimulus decoding of functional Magnetic Resonance Imaging (fMRI) data with machine learning models has provided new insights about neural representational spaces and task-related dynamics. However, the scarcity of labelled (taskrelated) fMRI data is a persistent obstacle, resulting in modelunderfitting and poor…
Weikang Qiu, Zheng Huang, Hang-Rui Hu, Aosong Feng + 2 more
Decoding functional magnetic resonance imaging (fMRI) signals into text has been a key challenge in the neuroscience community, with the potential to advance brain-computer interfaces and uncover deeper insights into brain mechanisms. However, existing approaches often struggle with suboptimal predictive performance…
Jingyuan Sun, Mingxiao Li, Zijiao Chen, Yunhao Zhang + 2 more
'Marie‐Francine Moens'] Decoding visual stimuli from neural responses recorded by functional Magnetic Resonance Imaging (fMRI) presents an intriguing intersection between cognitive neuroscience and machine learning, promising advancements in understanding human visual perception. However, the task is challenging due to…
Yulong Liu, Yongqiang Ma, Wei Zhou, Guibo Zhu + 1 more
Due to the lack of paired samples and the low signal-to-noise ratio of functional MRI (fMRI) signals, reconstructing perceived natural images or decoding their semantic contents from fMRI data are challenging tasks. In this work, we propose, for the first time, a task-agnostic fMRI-based brain decoding model…
Xuelin Qian, Yun Wang, Jingyang Huo, Jianfeng Feng + 1 more
The exploration of brain activity and its decoding from fMRI data has been a longstanding pursuit, driven by its potential applications in brain-computer interfaces, medical diagnostics, and virtual reality. Previous approaches have primarily focused on individual subject analysis, highlighting the need for a more…
Inhwa Han, Jaayeon Lee, Jong Chul Ye
via fMRI Authors: ['Inhwa Han' 'Jaayeon Lee' 'Jong Chul Ye'] Research efforts to understand neural signals have been ongoing for many years, with visual decoding from fMRI signals attracting considerable attention. Particularly, the advent of image diffusion models has advanced the reconstruction of images from fMRI…
Yanchen Wang, Adam Turnbull, Tiange Xiang, Yunlong Xu + 5 more
Analysis Using fMRI Foundation Models Authors: ['Yanchen Wang' 'Adam Turnbull' 'Tiange Xiang' 'Yunlong Xu' 'Sa Zhou' 'Askari Masoud' 'Shekoofeh Azizi' 'Feng Lin' 'Ehsan Adeli'] Neural decoding, the process of understanding how brain activity corresponds to different stimuli, has been a primary objective in cognitive…
Yuqin Dai, Z. P. Yao, Chunfeng Song, Qihao Zheng + 6 more
Visual Decoding from Limited fMRI Data Authors: ['Yuqin Dai' 'Z. P. Yao' 'Chunfeng Song' 'Qihao Zheng' 'W.Y. Mai' 'Kunyu Peng' 'Shuai Lü' 'Wanli Ouyang' 'Jian Yang' 'Jiamin Wu'] Brain decoding aims to reconstruct visual perception of human subject from fMRI signals, which is crucial for understanding brain's perception…
Jiahong Zhang, Jinning Zhao, Sijun Shen, Siyuan Xu + 2 more
Functional magnetic resonance imaging (fMRI)-based visual decoding aims to recover visual information from measured brain activity, commonly by mapping fMRI responses into latent visual features for downstream decoding tasks. Most existing methods learn mappings from fMRI responses to visual features extracted by…
Jingyang Huo, Yi‐Kai Wang, Xuelin Qian, Yun Wang + 3 more
Pretraining and Multi-level Modulation Authors: ['Jingyang Huo' 'Yi‐Kai Wang' 'Xuelin Qian' 'Yun Wang' 'Chong Li' 'Jianfeng Feng' 'Yanwei Fu'] Abstract. Recent fMRI-to-image approaches mainly focused on associating fMRI signals with specific conditions of pre-trained diffusion models. These approaches, while producing…
Matteo Ferrante, Tommaso Boccato, Nicola Toschi
To-date, brain decoding literature has focused on singlesubject studies, i.e. reconstructing stimuli presented to a subject under fMRI acquisition from the fMRI activity of the same subject. The objective of this study is to introduce a generalization technique that enables the decoding of a subject's brain based on…
W E I-Xing Huang
Pretrained Models Authors: ['W E I-Xing Huang'] Abstract—Semantic information is vital for human interaction, and decoding it from brain activity enables non-invasive clinical augmentative and alternative communication. While there has been significant progress in reconstructing visual images, few studies have focused…
Huzheng Yang, Jianbo Shi, James C. Gee
Brain encoding models aim to predict brain voxel-wise responses to stimuli images, replicating brain signals captured by neuroimaging techniques. There is a large volume of publicly available data, but training a comprehensive brain encoding model is challenging. The main difficulties stem from a) diversity within…