13 papers · ranked by Valyu relevance
Taosha Guo, Fabio Pasqualetti
The Hopfield network established that static memories can be stored as energy minima of a recurrent dynamical system, yet real intelligent agents must navigate \emph{sequences} of memories rather than isolated snapshots.Biological cortex addresses this through a separation of timescales: fast synaptic dynamics encode…
Ramy Mounir, Sudeep Sarkar
Sequential memory, the ability to form and accurately recall a sequence of events or stimuli in the correct order, is a fundamental prerequisite for biological and artificial intelligence as it underpins numerous cognitive functions (e.g., language comprehension, planning, episodic memory formation, etc.) However…
Songwei Dong, Zihan Chen, Chengshuai Shi, Peng Wang + 2 more
Memory plays a central role in enabling large language models (LLMs) to operate over sequential tasks by accumulating and reusing experience over time. However, existing evaluations of LLM memory mostly rely on aggregate metrics such as final hold-out accuracy or cumulative online performance, which can obscure…
Mufeng Tang, Helen C. Barron, Rafał Bogacz
Forming accurate memory of sequential stimuli is a fundamental function of biological agents. However, the computational mechanism underlying sequential memory in the brain remains unclear. Inspired by neuroscience theories and recent successes in applying predictive coding (PC) to static memory tasks, in this work we…
Laxmi R. Iyer, Ali A. Minai
—Learning meaningful sentences is different from learning a random set of words. When humans understand the meaning, the learning occurs relatively quickly. What mechanisms enable this to happen? In this paper, we examine the learning of novel sequences in familiar situations. We embed the Small World of Words…
Sangjun Park, JinYeong Bak
Making neural networks remember over the long term has been a longstanding issue. Although several external memory techniques have been introduced, most focus on retaining recent information in the short term. Regardless of its importance, information tends to be fatefully forgotten over time. We present Memoria, a…
Qi Zhang
Declarative memory, or explicit memory, can be fractionated into episodic memory and semantic memory (Tulving, 1972). Episodic memory refers to personally based memories and semantic memory refers to the memory of factual knowledge. The loss of the capacity in retaining episodic memory leads to various amnesias, e.g.…
Savya Khosla, Zhen Zhu, Yifie He
This paper explores Memory-Augmented Neural Networks (MANNs), delving into how they blend human-like memory processes into AI. It covers different memory types, like sensory, short-term, and long-term memory, linking psychological theories with AI applications. The study investigates advanced architectures such as…
Fabian Peller-Konrad, Rainer Kartmann, Christian Dreher, Andre Meixner + 3 more
'Andre Meixner' 'Fabian Reister' 'Markus Grotz' 'Tamim Asfour'] Cognitive agents such as humans and robots perceive their environment through an abundance of sensors producing streams of data that need to be processed to generate intelligent behavior. A key question of cognition-enabled and AI-driven robotics is how to…
Ishir Garg, Neel Kolhe, Dawn Song, Xuandong Zhao
Large language model (LLM) agents increasingly rely on external memory systems to remain consistent across long-horizon interactions, but little empirical work has been done to understand the specific failure modes and design choices that these systems present. Existing benchmarks report aggregate question-answering…
Zihong He, Weizhe Lin, Hao Zheng, Fan Zhang + 6 more
- Adaptive Storage. Part A of Fig. 9 illustrates the steps involved in long-term memory storage within SALM. The storage adapter evaluates whether external stimuli should be integrated into longterm memory, filtering out corrupted data, poisoned inputs, and privacy-sensitive information . It also determines the…
Parsa Omidi, Xingshuai Huang, Axel Laborieux, Bahareh Nikpour + 2 more
Memory is fundamental to intelligence, enabling learning, reasoning, and adaptability across biological and artificial systems. While Transformer architectures excel at sequence modeling, they face critical limitations in long-range context retention, continual learning, and knowledge integration. This review presents…
Jie Zhang
The ability to form memories is a basic feature of learning and accumulating knowledge. But where is memory information stored in the brain? Within the scientific research community, it is generally believed that memory information is stored in the synapse. However, this widely accepted dogma has been challenged by…