More Like this

1. Improving Sign Recognition with Phonology

   https://doi.org/10.18653/v1/2023.eacl-main.200  

   Kezar, Lee; Thomason, Jesse; Sehyr, Zed (January 2023, Association for Computational Linguistics)

   Vlachos, Andreas; Augenstein, Isabelle (Ed.)

   We use insights from research on American Sign Language (ASL) phonology to train models for isolated sign language recognition (ISLR), a step towards automatic sign language understanding. Our key insight is to explicitly recognize the role of phonology in sign production to achieve more accurate ISLR than existing work which does not consider sign language phonology. We train ISLR models that take in pose estimations of a signer producing a single sign to predict not only the sign but additionally its phonological characteristics, such as the handshape. These auxiliary predictions lead to a nearly 9% absolute gain in sign recognition accuracy on the WLASL benchmark, with consistent improvements in ISLR regardless of the underlying prediction model architecture. This work has the potential to accelerate linguistic research in the domain of signed languages and reduce communication barriers between deaf and hearing people. 

   more » « less
2. Simultaneous structures in sign languages: Acquisition and emergence

   https://doi.org/10.3389/fpsyg.2022.992589  

   Loos, Cornelia; German, Austin; Meier, Richard P. (December 2022, Frontiers in Psychology)

   The visual-gestural modality affords its users simultaneous movement of several independent articulators and thus lends itself to simultaneous encoding of information. Much research has focused on the fact that sign languages coordinate two manual articulators in addition to a range of non-manual articulators to present different types of linguistic information simultaneously, from phonological contrasts to inflection, spatial relations, and information structure. Children and adults acquiring a signed language arguably thus need to comprehend and produce simultaneous structures to a greater extent than individuals acquiring a spoken language. In this paper, we discuss the simultaneous encoding that is found in emerging and established sign languages; we also discuss places where sign languages are unexpectedly sequential. We explore potential constraints on simultaneity in cognition and motor coordination that might impact the acquisition and use of simultaneous structures. 

   more » « less
3. Conventionalization of Iconic Handshape Preferences in FamilyHomesign Systems

   Quam, M.; Brentari, D.; Coppola, M. (June 2022, Languages)

   Sandler, W.; Aronoff, M.; Padden, C. (Ed.)

   Variation in the linguistic use of handshapes exists across sign languages, but it is unclear how these iconic handshape preferences arise and become conventionalized. In order to understand the factors that shape such handshape preferences in the earliest stages of language emergence, we examined communication within family homesign systems. Homesigners are deaf individuals who have not acquired a signed or spoken language and who innovate unique gesture systems to communicate with hearing friends and family (“communication partners”). We analyzed how characteristics of participants and stimulus items influence handshape preferences and conventionalization. Participants included 11 deaf homesigners, 24 hearing communication partners (CPs), and 8 hearing non-signing adults from Nicaragua. Participants were asked to label items using gestures or signs. The handshape type (Handling, Object, or combined Handling+Object) was then coded. The participants and groups showed variability in iconic handshape preferences. Adult homesigners’ families demonstrated more conventionalization than did child homesigners’ families. Adult homesigners also used a combined Handling + Object form more than other participants. Younger CPs and those with fewer years of experience using a homesign system showed greater conventionalization. Items that elicited a reliable handshape preference were more likely to elicit Handling rather than Object handshapes. These findings suggest that similarity in terms of handshape type varies even within families, including hearing gesturers in the same culture. Although adult homesigners’ families were more conventionalized than child homesigners’ families, full conventionalization of these handshape preferences do not seem to appear reliably within two to three decades of use in a family when only one deaf homesigner uses it as a primary system. 

   more » « less
4. Conventionalization of Iconic Handshape Preferences in Family Homesign Systems

   https://doi.org/10.3390/languages7030156  

   Quam, Madeline; Brentari, Diane; Coppola, Maire (June 2022, Languages)

   Sandler, W.; Aronoff, M.; Padden C. (Ed.)

   Variation in the linguistic use of handshapes exists across sign languages, but it is unclear how these iconic handshape preferences arise and become conventionalized. In order to understand the factors that shape such handshape preferences in the earliest stages of language emergence, we examined communication within family homesign systems. Homesigners are deaf individuals who have not acquired a signed or spoken language and who innovate unique gesture systems to communicate with hearing friends and family (“communication partners”). We analyzed how characteristics of participants and stimulus items influence handshape preferences and conventionalization. Participants included 11 deaf homesigners, 24 hearing communication partners (CPs), and 8 hearing non-signing adults from Nicaragua. Participants were asked to label items using gestures or signs. 

   more » « less
5. Production of real signs but not pseudosigns affected by age of acquisition in American Sign Language

   https://doi.org/10.3758/s13421-024-01656-y  

   Lynne_Nielson, Shai; Mayberry, Rachel I (January 2025, Memory & Cognition)

   Research shows that insufficient language access in early childhood significantly affects language processing. While the majority of this work focuses on syntax, phonology also appears to be affected, though it is unclear exactly how. Here we investigated phonological production across age of acquisition of American Sign Language (ASL). Participants were deaf adult signers who first learned ASL at ages ranging from birth to 14 years and they performed both lexical decisions and repetitions of ASL signs and pseudosigns. Because phonological production has been understudied across age of acquisition, we were particularly interested in production accuracy for the sublexical phonological parameters of handshape, movement, and location. Lexical decision responses were slower and more accurate for impossible pseudosigns compared with possible pseudosigns, indicating participants were sensitive to ASL phonological structure regardless of age of acquisition. Despite this, age of acquisition affected repetition accuracy. Handshape errors were highest for those with earlier ages of acquisition, but movement errors were highest for those with later ages of acquisition, though this effect of age of acquisition was only seen for real ASL signs and not pseudosigns. The parameter error pattern for pseudosigns was not affected by age of acquisition. These results indicate that later age of acquisition does not inhibit the ability to produce ASL phonology but ultimately alters the processing of the phonological parameters when meaning and phonology are integrated. 

   more » « less