20 papers · ranked by Valyu relevance
Guy H. Wilson, Sergey D. Stavisky, Francis R. Willett, Donald T. Avansino + 5 more
To evaluate the potential of intracortical electrode array signals for brain-computer interfaces (BCIs) to restore lost speech, we measured the performance of classifiers trained to discriminate a comprehensive basis set for speech: 39 English phonemes. We classified neural correlates of spoken-out-loud words in the…
Marlies Gillis, Jill Kries, Jan Wouters, Laura Gwilliams + 1 more
This study investigates the neural dynamics of phoneme processing in 7-year-old children with and without dyslexia (25;9 ♂), using EEG recordings collected during continuous speech listening. By applying temporal generalization to phonetic descriptor decoding, we can disentangle whether potential phoneme processing…
Laura Gwilliams, Jean-Remi King, Alec Marantz, David Poeppel
Speech consists of a continuously-varying acoustic signal. Yet human listeners experience it as a sequence of discrete units (phonemes and words). To identify how the brain continuously represents and updates speech units, we recorded two-hour magnetoencephalograms from 21 subjects listening to short narratives. Our…
Jill Kries, Maaike Vandermosten, Laura Gwilliams
During successful language comprehension, speech sounds (phonemes) are encoded within a series of neural patterns that evolve over time. Here we tested whether these neural dynamics of speech encoding are altered for individuals with a language disorder. We recorded EEG responses from the human brains of 39 individuals…
Justin J. Jude, Stephanie Haro, Hadar Levi-Aharoni, Hiroaki Hashimoto + 10 more
Intracortical brain-computer interfaces (iBCIs) for decoding intended speech have provided individuals with ALS and severe dysarthria an intuitive method for high-throughput communication. These advances have been demonstrated in individuals who are still able to vocalize and move speech articulators. Here, we decoded…
Oli Danyi Liu, Hao Tang, Naomi H. Feldman, Sharon Goldwater
Speech representations in the human brain do not simply mirror the instantaneous speech signal; rather, they display several properties that are hypothesized to facilitate the integration of speech sounds into words. In particular, neural encodings of speech maintain information that has dissipated from the acoustics…
Laura Gwilliams, Jean-Remi King, Alec Marantz, David Poeppel
Speech consists of a continuously-varying acoustic signal. Yet human listeners experience it as sequences of discrete speech sounds, which are used to recognise discrete words. To examine how the human brain appropriately sequences the speech signal, we recorded two-hour magnetoencephalograms from 21 participants…
Xianhan Tan, Junming Zhu, Jianmin Zhang, Yueming Wang + 1 more
> Abstract Speech brain-computer interfaces (BCIs), which translate brain signals into spoken words or sentences, have shown significant potential for high-performance BCI communication. Phonemes are the fundamental units of pronunciation in most languages. While existing speech BCIs have largely focused on English…
Jingyuan Li, Trung Van Le, Chaofei Fan, Mingfei Chen + 1 more
Large Language Models Authors: ['Jingyuan Li' 'Trung Van Le' 'Chaofei Fan' 'Mingfei Chen' 'Eli Shlizerman'] Decoding attempted speech from neural activity offers a promising avenue for restoring communication abilities in individuals with speech impairments. Previous studies have focused on mapping neural activity to…
Jill Kries, Maaike Vandermosten, Laura Gwilliams
During successful language comprehension, speech sounds (phonemes) are encoded within a series of neural patterns that evolve over time. Here we tested whether these neural dynamics of speech encoding are altered for individuals with a language disorder. We recorded EEG responses from individuals with post-stroke…
Oli Danyi Liu, Hao Tang, Naomi H. Feldman, Sharon Goldwater
effects found in neural representations of continuous speech Authors: ['Oli Danyi Liu' 'Hao Tang' 'Naomi H. Feldman' 'Sharon Goldwater'] Speech perception involves storing and integrating sequentially presented items. Recent work in cognitive neuroscience has identified temporal and contextual characteristics in…
Johannes C. Ziegler, Conrad Perry, Marco Zorzi
The most influential theory of learning to read is based on the idea that children rely on phonological decoding skills to learn novel words. According to the self-teaching hypothesis, each successful decoding encounter with an unfamiliar word provides an opportunity to acquire word-specific orthographic information…
Siddharth Dalmia, Xinjian Li, Alan W. Black, Florian Metze
Building multilingual and crosslingual models help bring different languages together in a language universal space. It allows models to share parameters and transfer knowledge across languages, enabling faster and better adaptation to a new language. These approaches are particularly useful for low resource languages.…
Benyamin Abramovich Krasa, Erin M. Kunz, Foram Kamdar, Donald Avansino + 11 more
Speech requires precise serial ordering of words and phonemes into novel combinations. To accomplish this, the brain is believed to flexibly prepare utterances before producing them, even allowing pronunciation of never-before spoken words. To discover how neural populations achieve this, intracortical activity from…
Shubham Toshniwal, Karen Livescu
We propose an attention-enabled encoder-decoder model for the problem of grapheme-to-phoneme conversion. Most previous work has tackled the problem via joint sequence models that require explicit alignments for training. In contrast, the attention-enabled encoder-decoder model allows for jointly learning to align and…
Moniek M. H. Schaars, Eliane Segers, Ludo Verhoeven
The present longitudinal study aimed to investigate the development of word decoding skills during incremental phonics instruction in Dutch as a transparent orthography. A representative sample of 973 Dutch children in the first grade (M*age = 6;1, SD* = 0;5) was exposed to incremental subsets of Dutch grapheme-phoneme…
Steve Young
Automatic continuous speech recognition (CSR) is sufficiently mature that a variety of real world applications are now possible including large vocabulary transcription and interactive spoken dialogues. This paper reviews the evolution of the statistical modelling techniques which underlie current-day systems…
Aparecido J. C. Soares, Fernanda C. Sassi, Talita Fortunato-Tavares, Claudia R. F. Andrade + 2 more
Decoding skills are crucial for literacy development and they tend to be acquired early in transparent languages, such as Brazilian Portuguese. It is essential to better understand which variables may affect the decoding process. In this study, we investigated the processes of decoding as a function of age of children…
Sascha Couvee, Loes Wauters, Harry Knoors, Ludo Verhoeven + 1 more
'Eliane Segers'] Background: Deaf and hard-of-hearing (DHH) children may experience difficulties in word decoding development. Aims: We aimed to compare and predict the incremental word decoding development in first grade in Dutch DHH and hearing children, as a function of kindergarten reading precursors. Methods and…
Samuel Rose, C. Kambhampati
Fuzzy Inference System Authors: ['Samuel Rose' 'C. Kambhampati'] Abstract—In Linguistics, a grapheme is a written unit of a writing system corresponding to a phonological sound. In Natural Language Processing tasks, written language is analysed through two different mediums, word analysis, and character analysis. This…