21 papers · ranked by Valyu relevance
Boon Giin Lee, Teak-Wei Chong, Wan-Young Chung
Sign language was designed to allow hearing-impaired people to interact with others. Nonetheless, knowledge of sign language is uncommon in society, which leads to a communication barrier with the hearing-impaired community. Many studies of sign language recognition utilizing computer vision (CV) have been conducted…
Lee Kezar, Nidhi Munikote, Zian Zeng, Zed Sevcikova Sehyr + 2 more
Linguistic Knowledge Authors: ['Lee Kezar' 'Nidhi Munikote' 'Zian Zeng' 'Zed Sevcikova Sehyr' 'Naomi Caselli' 'Jesse Thomason'] Language models for American Sign Language (ASL) could make language technologies substantially more accessible to those who sign. To train models on tasks such as isolated sign recognition…
Biyi Fang, Jillian Co, Mi Zhang
There is an undeniable communication barrier between deaf people and people with normal hearing ability. Although innovations in sign language translation technology aim to tear down this communication barrier, the majority of existing sign language translation systems are either intrusive or constrained by resolution…
Jungpil Shin, Akitaka Matsuoka, Md. Al Mehedi Hasan, Azmain Yakin Srizon + 1 more
'Azmain Yakin Srizon' 'Jiayi Ma'] Sign language is designed to assist the deaf and hard of hearing community to convey messages and connect with society. Sign language recognition has been an important domain of research for a long time. Previously, sensor-based approaches have obtained higher accuracy than…
Bader Alsharif, Ali Salem Altaher, Ahmed Altaher, Mohammad Ilyas + 3 more
'Easa Alalwany' 'Panagiotis Pintelas' 'Zhe-Ming Lu'] Historically, individuals with hearing impairments have faced neglect, lacking the necessary tools to facilitate effective communication. However, advancements in modern technology have paved the way for the development of various tools and software aimed at…
Sevgi Zübeyde Gürbüz, Ali Cafer Gürbüz, Evie Malaia, Darrin J. Griffin + 6 more
'Darrin J. Griffin' 'Chris Crawford' 'Mohammed Mahbubur Rahman' 'Emre Kurtoğlu' 'Ridvan Aksu' 'Trevor Macks' 'Robiulhossain Mdrafi'] Abstract—Many technologies for human-computer interaction have been designed for hearing individuals and depend upon vocalized speech, precluding users of American Sign Language (ASL) in…
Justin M. Power
In contrast to scholars and signers in the nineteenth century, William Stokoe conceived of American Sign Language (ASL) as a unique linguistic tradition with roots in nineteenth-century langue des signes française, a conception that is apparent in his earliest scholarship on ASL. Stokoe thus contributed to the…
Raja Kushalnagar
The viewing size of a signer correlates with legibility, i.e., the ease with which a viewer can recognize individual signs. The WCAG 2.0 guidelines (G54) mention in the notes that there should be a mechanism to adjust the size to ensure the signer is discernible but does not state minimum discernibility guidelines. The…
Han Zhang, Rotem Shalev-Arkushin, Vasileios Baltatzis, C. Gillis + 6 more
Sign languages are crucial for communication within the Deaf and Hard-of-Hearing (DHH) communities . As naturallyemerging and fully-fledged languages, they enable individuals to convey complex ideas, emotions, and cultural nuances through movements and facial expressions . Despite their importance for many DHH people…
Carol Neidle, Augustine Opoku, Carey M. Ballard, Yang Zhou + 3 more
'Xiaoxiao He' 'Gregory Dimitriadis' 'Dimitris Metaxas'] Abstract. Looking up an unknown sign in an ASL dic1onary can be difficult. Most ASL dic1onaries are organized based on English glosses, despite the fact that (1) there is no conven1on for assigning English-based glosses to ASL signs; and (2) there is no 1-1…
Aurora Martinez del Rio, Casey Ferrara, Sanghee J. Kim, Emre Hakgüder + 1 more
Over the history of research on sign languages, much scholarship has highlighted the pervasive presence of signs whose forms relate to their meaning in a non-arbitrary way. The presence of these forms suggests that sign language vocabularies are shaped, at least in part, by a pressure toward maintaining a link between…
Marcus Perlman, Hannah Little, Bill Thompson, Robin L. Thompson
Considerable evidence now shows that all languages, signed and spoken, exhibit a significant amount of iconicity. We examined how the visual-gestural modality of signed languages facilitates iconicity for different kinds of lexical meanings compared to the auditory-vocal modality of spoken languages. We used iconicity…
Garrett Tanzer, Maximus Shengelia, Ken Harrenstien, David Uthus
Historically, sign language machine translation has been posed as a sentence-level task: datasets consisting of continuous narratives are chopped up and presented to the model as isolated clips. In this work, we explore the limitations of this task framing. First, we survey a number of linguistic phenomena in sign…
Mohammad Eslami, Mahdi Karami, Solale Tabarestani, Farah Torkamani‐Azar + 2 more
'Farah Torkamani‐Azar' 'Sedigheh Eslami' 'Christoph Meinel'] Abstract—Sign(ed) languages use gestures, such as hand or head movements, for communication. Sign language recognition is an assistive technology for individuals with hearing disability and its goal is to improve such individuals' life quality by facilitating…
Hernandez Vincent, Suzuki Tomoya, Venture Gentiane
Human Action Recognition (HAR) is an important and difficult topic because of the important variability between tasks repeated several times by a subject and between subjects. This work is motivated by providing time-series signal classification and a robust validation and test approaches. This study proposes to…
Rıdvan Yayla, Hakan Üçgün, Mahmud Abbas, Carlos M. Travieso-González
Advancements in artificial intelligence have significantly enhanced communication for individuals with hearing impairments. This study presents a robust cross-lingual Sign Language Recognition (SLR) framework for Turkish, American English, and Arabic sign languages. The system utilizes the lightweight MediaPipe library…
Authors not listed
When a person observes someone else performing an action, the observer’s sensorimotor cortex activates as if the observer is the one performing the action, a phenomenon known as action simulation. While this process has been well-established for basic (e.g. grasping) and complex (e.g. dancing) actions, it remains…
Shai Lynne Nielson, Rachel I. Mayberry
Research shows that insufficient language access in early childhood significantly affects language processing. While the majority of this work focuses on syntax, phonology also appears to be affected, though it is unclear exactly how. Here we investigated phonological production across age of acquisition of American…
Lorna C. Quandt, Emily Kubicek
Bilingual individuals automatically translate written words from one language to another. While this process is established in spoken-language bilinguals, there is less known about its occurrence in deaf bilinguals who know signed and spoken languages. Since sign language uses motion and space to convey linguistic…
Yuke Yan, James G. Goodman, Dalton D. Moore, Sliman J. Bensmaia
How does the brain control an effector as complex and versatile as the hand? One possibility is that the neural control of the hand is simplified by limiting the number of achievable hand postures. Indeed, hand kinematics can be largely accounted for within a small subspace. This oft replicated finding has been…
Annahita Sarré, Laurent Cohen
For many deaf people, lip-reading plays a major role in verbal communication. However, lip movements are by nature ambiguous, so that lip reading does not allow for a full understanding of speech. The resulting language access difficulties may have serious consequences on language, cognitive and social development.…