14 papers · ranked by Valyu relevance
Daniel Szelogowski
Despite substantial research into the biological basis of memory, the precise mechanisms by which experiences are encoded, stored, and retrieved in the brain remain incompletely understood. A growing body of evidence supports the engram theory, which posits that sparse populations of neurons undergo lasting physical…
Mark H. Histed
cortex Authors: ['Mark H. Histed'] Our brains encode many features of the sensory world into memories: we can sing along with songs we have heard before, interpret spoken and written language composed of words we have learned, and recognize faces and objects. Where are these memories stored? Each area of the cerebral…
Yifei Mao
The algorithm of brain learning and memory is still undetermined. The backpropagation algorithm of artificial neural networks was thought not suitable for brain cortex, and there is a lack of algorithm for memory engram. We designed a brain version of backpropagation algorithm, which are biologically plausible and…
Lisa Blum Moyse, Hugues Berry
The standard consolidation theory states that short-term memories located in the hippocampus enable the consolidation of long-term memories in the neocortex. In other words, the neocortex slowly learns long-term memories with a transient support of the hippocampus that quickly learns unstable memories. However, it is…
Daniel Szelogowski
Despite success across diverse tasks, current artificial recurrent network architectures rely primarily on implicit hidden-state memories, limiting their interpretability and ability to model long-range dependencies. In contrast, biological neural systems employ explicit, associative memory traces (i.e., engrams)…
Yutang Ma, Kecheng Huang, Xikun Jiang, Zili Shao
Large Language Models (LLMs) store factual knowledge and domain-specific patterns implicitly in dense Transformer parameters, making knowledge expansion costly through pretraining, fine-tuning, retrieval augmentation, or longer contexts. Engram-style memory offers a compact hidden-state injection pathway, but existing…
Alessandro Fontana
The standard model of memory consolidation foresees that memories are initially recorded in the hippocampus, while features that capture higher-level generalisations of data are created in the cortex, where they are stored for a possibly indefinite period of time. Computer scientists have sought inspiration from nature…
Arno Granier, Katharina A. Wilmes, Mihai A. Petrovici, Walter Senn
Neuronal circuits of the cerebral cortex are the structural basis of mammalian cognition. The same qualitative components and connectivity motifs are repeated across functionally specialized cortical areas and mammalian species, suggesting a single underlying algorithmic motif. Here, we propose a perspective on current…
Jinghao Wang, Qiyuan He, Chunbin Gu, Pheng-Ann Heng
The Engram module -- a hash-keyed, O(1) associative memory injected into Transformer layers -- was recently shown to improve large language model pretraining, with the appealing interpretation that it provides a content-addressed shortcut to recurring local token patterns. We ask whether this interpretation transfers…
Daniel Pouzzner
Since the earliest electroencephalography experiments, large scale oscillations have been observed in the mammalian brain. In more recent studies they have been identified not only in the cerebral cortex and thalamus, but pervasively in the healthy basal ganglia. While correlations with stimuli, behavior, and mental…
Michael R. Ferrier
The human brain carries out a broad array of functions, and there is ample evidence that it is the cerebral cortex, taking up three quarters of the brain's volume, that plays a central role in perception, cognition, and behavior. However, notwithstanding the variety and complexity of the tasks performed by the cerebral…
Hin Wai Lui
This paper proposes a theoretical framework for the biological learning mechanism as a general learning system. The proposal is as follows. The bursting and tonic modes of firing patterns found in many neuron types in the brain correspond to two separate modes of information processing, with one mode resulting in…
Gary Marcus, Adam Marblestone, Thomas Dean
One common view holds that that the human neocortex consists of a single, massivelyrepeated, "canonical" computation (Creutzfeldt, 1977; George & Hawkins, 2009; Hawkins & Blakeslee, 2007; Kurzweil, 2012; Mountcastle, 1978). But, after forty years, there is still no consensus about the nature of such a putative…
Jia Peng Lim, Hai Leong Chieu
Deepseek's Engram, a conditional memory module, was introduced to trade-off storage versus reasoning in large language models. However, the module relies on token-level $N$-gram hashing for Engram embedding lookup, introducing a tight coupling to the tokenizer used: a model with a different tokenizer would have to…