Title: Activation of ASL signs during sentence reading for deaf readers: evidence from eye-tracking
Abstract Bilinguals activate both of their languages as they process written words, regardless of modality (spoken or signed); these effects have primarily been documented in single word reading paradigms. We used eye-tracking to determine whether deaf bilingual readers (n= 23) activate American Sign Language (ASL) translations as they read English sentences. Sentences contained a target word and one of the two possible prime words: a related prime which shared phonological parameters (location, handshape or movement) with the target when translated into ASL or an unrelated prime. The results revealed that first fixation durations and gaze durations (early processing measures) were shorter when target words were preceded by ASL-related primes, but prime condition did not impact later processing measures (e.g., regressions). Further, less-skilled readers showed a larger ASL co-activation effect. Together, the results indicate that ASL co-activation impacts early lexical access and can facilitate reading, particularly for less-skilled deaf readers.  more » « less
Award ID(s):
2120546 1651372
PAR ID:
10678220
Author(s) / Creator(s):
; ;
Publisher / Repository:
Cambridge Press
Date Published:
Journal Name:
Bilingualism: Language and Cognition
Volume:
28
Issue:
1
ISSN:
1366-7289
Page Range / eLocation ID:
208 to 216
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. Eye-tracking corpora have advanced our understanding of reading processes by providing large-scale datasets of naturalistic reading behavior. However, existing corpora have almost exclusively sampled from typically hearing readers of spoken languages. Here, we present the Signers’ Eye-movements in English Reading (SEER) Corpus, a dataset of eye-movement behaviors from 41 skilled deaf adult readers who are early signers of American Sign Language (ASL), as well as a comparative group of 101 typically hearing monolingual English readers. Participants read 200 English sentences presented one at a time. In addition to eye-tracking data, the corpus includes detailed participant information: a standardized measure of reading proficiency, spelling recognition, and nonverbal intelligence for all participants. Information for the deaf participants include ASL comprehension scores, age of ASL acquisition, and phonological awareness scores (for a subset of participants). We report comparative analyses of reading behaviors at both the word level and sentence level. We also examine group differences in the effects of word length, frequency, and surprisal on local measures. The results indicate stronger effects of length and surprisal, but equivalent frequency effects (on content words) for deaf compared to hearing readers. The SEER Corpus offers researchers the opportunity to test hypotheses about reading development and efficiency in bimodal bilinguals who are first language users of ASL and skilled readers of English, supporting broader investigations of visual language processing. The corpus is preregistered and publicly availableat https://doi.org/10.17605/OSF.IO/7P4F2 to facilitate replication, cross-study comparisons, and exploration of preliminary hypotheses in this understudied population. 
    more » « less
  2. ABSTRACT This study investigates how expectancy and plausibility influence behavioral and neural measures of language processing during naturalistic reading comprehension. Prior event‐related potential (ERP) studies show evidence of distinct post‐N400 positivities to violations of semantic expectancy and plausibility using artificial serial presentation but have yet to establish these phenomena during naturalistic reading. Therefore, we recorded simultaneous eye movements and EEG while participants read highly constraining sentences with expected, unexpected (but plausible), and anomalous target words. Time locked to the pre‐target word, we observed a contextually graded parafoveal N400 effect. The N400 was facilitated (i.e., reduced) when the word was subsequently fixated, suggesting trans‐saccadic integration of semantic features. At target fixation, we also observed a late anteriorly distributed positivity to unexpected target words and a posteriorly distributed positivity to anomalous target words, effects that were not clearly present when time locked to the pre‐target word. Eye‐tracking (ET) measures show that readers were sensitive to both expectancy and plausibility at target fixation. In conclusion, we show that readers can begin accessing semantic information in parafoveal vision, but higher‐level semantic processing may require the orchestration of both parafoveal and foveal representations. 
    more » « less
  3. Abstract Both deaf and hearing readers use morphological awareness skills to decode and comprehend printed English. Deaf readers, for whom phonological awareness is a relative weakness while orthographic sensitivity is a strength, may have a different relationship with morphology than similarly skilled hearing readers. This study investigated the impact of various reading sub-skills—spelling, vocabulary size, morphological awareness, and phonological awareness—on reading comprehension for deaf and hearing adult readers. Morphological awareness had a stronger relationship with reading comprehension for deaf than hearing readers, particularly for deaf readers with advanced morphological skills. Morphology and vocabulary were also more strongly related for the deaf group, indicating that deaf readers leverage morphology to expand their word knowledge. Overall, the findings highlight the unique and significant role of morphological awareness in the skilled deaf reader’s “toolbox” and underscore the importance of morphological instruction in supporting the reading development of deaf individuals. 
    more » « less
  4. Little is known about how information to the left of fixation impacts reading and how it may help to integrate what has been read into the context of the sentence. To better understand the role of this leftward information and how it may be beneficial during reading, we compared the sizes of the leftward span for reading-matched deaf signers ( n = 32) and hearing adults ( n = 40) using a gaze-contingent moving window paradigm with windows of 1, 4, 7, 10, and 13 characters to the left, as well as a no-window condition. All deaf participants were prelingually and profoundly deaf, used American Sign Language (ASL) as a primary means of communication, and were exposed to ASL before age eight. Analysis of reading rates indicated that deaf readers had a leftward span of 10 characters, compared to four characters for hearing readers, and the size of the span was positively related to reading comprehension ability for deaf but not hearing readers. These findings suggest that deaf readers may engage in continued word processing of information obtained to the left of fixation, making reading more efficient, and showing a qualitatively different reading process than hearing readers. 
    more » « less
  5. Corina, David P. (Ed.)
    Letter recognition plays an important role in reading and follows different phases of processing, from early visual feature detection to the access of abstract letter representations. Deaf ASL–English bilinguals experience orthography in two forms: English letters and fingerspelling. However, the neurobiological nature of fingerspelling representations, and the relationship between the two orthographies, remains unexplored. We examined the temporal dynamics of single English letter and ASL fingerspelling font processing in an unmasked priming paradigm with centrally presented targets for 200 ms preceded by 100 ms primes. Event-related brain potentials were recorded while participants performed a probe detection task. Experiment 1 examined English letter-to-letter priming in deaf signers and hearing non-signers. We found that English letter recognition is similar for deaf and hearing readers, extending previous findings with hearing readers to unmasked presentations. Experiment 2 examined priming effects between English letters and ASL fingerspelling fonts in deaf signers only. We found that fingerspelling fonts primed both fingerspelling fonts and English letters, but English letters did not prime fingerspelling fonts, indicating a priming asymmetry between letters and fingerspelling fonts. We also found an N400-like priming effect when the primes were fingerspelling fonts which might reflect strategic access to the lexical names of letters. The studies suggest that deaf ASL–English bilinguals process English letters and ASL fingerspelling differently and that the two systems may have distinct neural representations. However, the fact that fingerspelling fonts can prime English letters suggests that the two orthographies may share abstract representations to some extent. 
    more » « less