Learning to process speech in a foreign language involves learning new representations for mapping the auditory signal to linguistic structure. Behavioral experiments suggest that even listeners that are highly proficient in a non-native language experience interference from representations of their native language. However, much of the evidence for such interference comes from tasks that may inadvertently increase the salience of native language competitors. Here we tested for neural evidence of proficiency and native language interference in a naturalistic story listening task. We studied electroencephalography responses of 39 native speakers of Dutch (14 male) to an English short story, spoken by a native speaker of either American English or Dutch. We modeled brain responses with multivariate temporal response functions, using acoustic and language models. We found evidence for activation of Dutch language statistics when listening to English, but only when it was spoken with a Dutch accent. This suggests that a naturalistic, monolingual setting decreases the interference from native language representations, whereas an accent in the listener's own native language may increase native language interference, by increasing the salience of the native language and activating native language phonetic and lexical representations. Brain responses suggest that such interference stems from words from the native language competing with the foreign language in a single word recognition system, rather than being activated in a parallel lexicon. We further found that secondary acoustic representations of speech (after 200 ms latency) decreased with increasing proficiency. This may reflect improved acoustic–phonetic models in more proficient listeners.
- Award ID(s):
- 1632849
- NSF-PAR ID:
- 10147314
- Date Published:
- Journal Name:
- International journal of cognitive science engineering and technology
- ISSN:
- 2347-8047
- Format(s):
- Medium: X
- Sponsoring Org:
- National Science Foundation
More Like this
-
Significance Statement Behavioral experiments suggest that native language knowledge interferes with foreign language listening, but such effects may be sensitive to task manipulations, as tasks that increase metalinguistic awareness may also increase native language interference. This highlights the need for studying non-native speech processing using naturalistic tasks. We measured neural responses unobtrusively while participants listened for comprehension and characterized the influence of proficiency at multiple levels of representation. We found that salience of the native language, as manipulated through speaker accent, affected activation of native language representations: significant evidence for activation of native language (Dutch) categories was only obtained when the speaker had a Dutch accent, whereas no significant interference was found to a speaker with a native (American) accent. -
Abstract For nearly 25 years, researchers have recognized the rich and numerous facets of native perception of non‐native speech, driving a large, and growing, body of work that has shed light on how native listeners understand non‐native speech. The bulk of this work, however, has focused on the talker. That is, most researchers have asked what perception of non‐native speech tells us about the non‐native speaker, or when interacting with non‐native speakers more generally. It is clear that listeners perceive speech not only in terms of the acoustic signal, but also with their own experience and biases driving their perception. It is also clear that native listeners can improve their perception of non‐native speech for both familiar and unfamiliar accents. Therefore, it is imperative that research in non‐native communication also consider an active role for the listener. To truly understand communication between native and non‐native speakers, it is critically important to understand both the properties of non‐native speech and how this speech is perceived. In the present review, we describe non‐native speech and then review previous research, examining the methodological shift from using native listeners as tools to understand properties of non‐native speech to understanding listeners as partners in conversation. We discuss how current models not only limit our understanding of non‐native speech, but also limit what types of questions researchers set out to answer. We demonstrate that while non‐native speakers capable of shifting their productions to be better understood by listeners, native listeners are also capable of shifting their perception to more accurately perceive non‐native speech. We conclude by setting forth a series of recommendations for future research, emphasizing the contributions of native listeners and non‐native speakers as equally important for communicative success.
-
Abstract Theories of dishonest behavior implicitly assume language independence. Here, we investigated this assumption by comparing lying by people using a foreign language versus their native tongue. Participants rolled a die and were paid according to the outcome they reported. Because the outcome was private, they could lie to inflate their profit without risk of repercussions. Participants performed the task either in their native language or in a foreign language. With native speakers of Hebrew, Korean, Spanish, and English, we discovered that, on average, people inflate their earnings less when they use a foreign language. The outcome is explained by a dual system account that suggests that self‐serving dishonesty is an automatic tendency, which is supported by a fast and intuitive system. Because using a foreign language is less intuitive and automatic, it might engage more deliberation and reduce the temptation to lie. These findings challenge theories of ethical behavior to account for the role of the language in shaping ethical behavior.
-
Abstract The current study utilized eye-tracking to investigate the effects of intersensory redundancy and language on infant visual attention and detection of a change in prosody in audiovisual speech. Twelve-month-old monolingual English-learning infants viewed either synchronous (redundant) or asynchronous (non-redundant) presentations of a woman speaking in native or non-native speech. Halfway through each trial, the speaker changed prosody from infant-directed speech (IDS) to adult-directed speech (ADS) or vice versa. Infants focused more on the mouth of the speaker on IDS trials compared to ADS trials regardless of language or intersensory redundancy. Additionally, infants demonstrated greater detection of prosody changes from IDS speech to ADS speech in native speech. Planned comparisons indicated that infants detected prosody changes across a broader range of conditions during redundant stimulus presentations. These findings shed light on the influence of language and prosody on infant attention and highlight the complexity of audiovisual speech processing in infancy.more » « less
-
Expectation is a powerful mechanism in native-language processing. Less is known about its role in non-native language processing, especially for expectations at the discourse level. This study presents evidence from a story-continuation task, adapted from previous work with native speakers (Rohde et al., 2006), probing next-mention and coherence expectations among Japanese- and Korean-speaking learners of English. As in previous work, verbal aspect (perfective/imperfective) in a context sentence describing a transfer-of-possession event (e.g., Ron gave/was giving a towel to Patrick) modulated participants’ choices of next referents in their continuations. However, this effect was diminished in the non-native compared to the native-speaker group, despite comparable performance on an independent task assessing knowledge of verbal aspect in English, and previous evidence for significant effects of aspect on referential patterns in native Japanese and Korean processing (Ueno & Kehler, 2010; Kim et al., 2013). The two groups of speakers were equally sensitive to a cue that does not require predictive processing – the referential form of the story-continuation prompt – in that both groups were significantly more likely to establish reference to the discourse topic/Source of the transfer event for pronoun-initial continuations than for name-initial ones. Moreover, recency played a stronger role in non-native speakers’ referential choices than in those of native speakers. These results suggest that while native speakers engage in proactive discourse processing, non-native speakers are less able to do so, being sufficiently burdened by reactive processes required for information integration that they have only Reduced Ability to Generate Expectations (RAGE).more » « less