Paraphernalia
PPubMed5 May 2026

The current status of foundation models in decoding inner speech from non-invasive brain signals: a mini review

Esra Sümer-Arpak, Rajkumar Saini, Debashis Das Chakladar, Sanjeev Kumar Varun, Foteini Simistira Liwicki

Abstract

Inner speech (IS), or imagined speech without overt articulation, is a promising target for brain-computer interfaces (BCIs) aimed at restoring communication in individuals with severe speech impairments, such as locked-in syndrome. Foundation models (FMs), typically trained using self-supervised learning (SSL) on large-scale datasets, offer new opportunities for learning transferable and robust representations from neural signals. This mini review provides an overview of FM-based approaches for IS decoding using non-invasive neuroimaging modalities, including functional magnetic resonance imaging, electroencephalography, magnetoencephalography, and functional near-infrared spectroscopy, highlighting architectural trends, pretraining strategies, and model adaptation techniques. We discuss how recent models move beyond task-specific classification toward scalable representation learning and semantic-level decoding. Despite these advances, several challenges remain, including the weak, noisy, and non-stationary nature of neural signals, variability in data acquisition, and limitations in dataset scale, standardization, computational resources, interpretability, and evaluation metrics. Ethical and privacy considerations are also critical. Overall, FMs provide a promising paradigm for non-invasive IS decoding, addressing neurophysiological, methodological, and ethical challenges is essential for developing scalable and reliable BCI systems.

A figure from The current status of foundation models in decoding inner speech from non-invasive brain signals: a mini review
fig. from the paper

§ The Valyu brief

Reading the full paper and taking notes. This takes a few seconds…

§ Ask this paper

Ask a question about this paper

Valyu reads the full text and answers from what the paper actually says.

Q.

Searching the other archives…