Abstract Perception changes rapidly and implicitly as a function of passive exposure to speech that samples different acoustic distributions. Past research has shown that this statistical learning generalizes across talkers and, to some extent, new items, but these studies involved listeners’ active engagement in processing statistics-bearing stimuli. In this study, we manipulated the relationship between voice onset time (VOT) and fundamental frequency (F0) to establish distributional regularities either aligned with American English or reversed to create a subtle foreign accent. We then tested whether statistical learning across passive exposure to these distributions generalized to new items never experienced in the accent. Experiment 1 showed statistical learning across passive exposure but no generalization of learning when exposure and test items shared the same initial consonant but differed in vowels (bear/pear → beer/pier) or when they differed in initial consonant but shared distributional regularities across VOT and F0 dimensions (deer/tear → beer/pier). Experiment 2 showed generalization to stimuli that shared the statistics-bearing phoneme (bear/pear → beer/pier), but only when the response set included tokens from both exposure and generalization stimuli. Moreover, statistical learning transferred to influence the subtle acoustics of listeners’ own speech productions but did not generalize to influence productions of stimuli not heard in the accent. In sum, passive exposure is thus sufficient to support statistical learning and its generalization, but task demands modulate this dynamic. Moreover, production does not simply mirror perception: generalization in perception was not accompanied by transfer to production.
more »
« less
Transfer of statistical learning from passive speech perception to speech production
Abstract Communicating with a speaker with a different accent can affect one’s own speech. Despite the strength of evidence for perception-production transfer in speech, the nature of transfer has remained elusive, with variable results regarding the acoustic properties that transfer between speakers and the characteristics of the speakers who exhibit transfer. The current study investigates perception-production transfer through the lens of statistical learning across passive exposure to speech. Participants experienced a short sequence of acoustically variable minimal pair (beer/pier) utterances conveying either an accent or typical American English acoustics, categorized a perceptually ambiguous test stimulus, and then repeated the test stimulus aloud. In thecanonicalcondition, /b/–/p/ fundamental frequency (F0) and voice onset time (VOT) covaried according to typical English patterns. In thereversecondition, the F0xVOT relationship reversed to create an “accent” with speech input regularities atypical of American English. Replicating prior studies, F0 played less of a role in perceptual speech categorization in reverse compared with canonical statistical contexts. Critically, this down-weighting transferred to production, with systematic down-weighting of F0 in listeners’ own speech productions in reverse compared with canonical contexts that was robust across male and female participants. Thus, the mapping of acoustics to speech categories is rapidly adjusted by short-term statistical learning across passive listening and these adjustments transfer to influence listeners’ own speech productions.
more »
« less
- Award ID(s):
- 2346989
- PAR ID:
- 10523490
- Publisher / Repository:
- Psychonomic Bulletin & Review
- Date Published:
- Journal Name:
- Psychonomic Bulletin & Review
- Volume:
- 31
- Issue:
- 3
- ISSN:
- 1069-9384
- Page Range / eLocation ID:
- 1193 to 1205
- Subject(s) / Keyword(s):
- Sponsoring Org:
- National Science Foundation
More Like this
-
-
Purpose The “bubble noise” technique has recently been introduced as a method to identify the regions in time–frequency maps (i.e., spectrograms) of speech that are especially important for listeners in speech recognition. This technique identifies regions of “importance” that are specific to the speech stimulus and the listener, thus permitting these regions to be compared across different listener groups. For example, in cross-linguistic and second-language (L2) speech perception, this method identifies differences in regions of importance in accomplishing decisions of phoneme category membership. This research note describes the application of bubble noise to the study of language learning for 3 different language pairs: Hindi English bilinguals' perception of the /v/–/w/ contrast in American English, native English speakers' perception of the tense/lax contrast for Korean fricatives and affricates, and native English speakers' perception of Mandarin lexical tone. Conclusion We demonstrate that this technique provides insight on what information in the speech signal is important for native/first-language listeners compared to nonnative/L2 listeners. Furthermore, the method can be used to examine whether L2 speech perception training is effective in bringing the listener's attention to the important cues.more » « less
-
Accents are ubiquitous in spoken communication, and while listeners can rapidly adapt to accented speech, the neural mechanisms supporting this flexibility remain poorly understood. Successful adaptation requires developing new sound representations without compromising the stability of long-term speech norms. This delicate balance between plasticity and stability illustrates a fundamental challenge faced by all cognitive systems. To investigate how the brain manages this trade-off, we recorded electroencephalographic activity from 23 native English speakers as they categorized words produced in either canonical American English or an unfamiliar accent. We contrasted two potential mechanisms: one in which listeners fully restructure their sound-to-category mappings to reflect accent-specific pronunciations, and another in which they downweight the functional relevance of sounds that deviate from long-term expectations. Listeners relied on short-term speech regularities to reduce perceptual weighting of acoustic dimensions that did not conform to the canonical norm. Consistent with this perceptual shift, we observed less robust neural encoding of sound differences along the downweighted dimensions. Notably, these adaptive neural adjustments emerged as early as 100 milliseconds, at latencies associated with subphonemic auditory processing, and persisted through later stages linked to phonological and post-phonological processing. These findings indicate that rapid adaptation to unfamiliar accents involves downweighting the functional relevance of sound cues based on short-term input statistics, rather than fully restructuring native sound-to-category mappings. This mechanism enables flexible adjustment to novel speech inputs while preserving long-term linguistic representations, illustrating how the auditory system negotiates the trade-off between plasticity and representational stability.more » « less
-
Speech categories are defined by multiple acoustic dimensions and their boundaries are generally fuzzy and ambiguous in part because listeners often give differential weighting to these cue dimensions during phonetic categorization. This study explored how a listener's perception of a speaker's socio-indexical and personality characteristics influences the listener's perceptual cue weighting. In a matched-guise study, three groups of listeners classified a series of gender-neutral /b/-/p/ continua that vary in VOT and F0 at the onset of the following vowel. Listeners were assigned to one of three prompt conditions (i.e., a visually male talker, a visually female talker, or audio-only) and rated the talker in terms of vocal (and facial, in the visual prompt conditions) gender prototypicality, attractiveness, friendliness, confidence, trustworthiness, and gayness. Male listeners and listeners who saw a male face showed less reliance on VOT compared to listeners in the other conditions. Listeners' visual evaluation of the talker also affected their weighting of VOT and onset F0 cues, although the effects of facial impressions differ depending on the gender of the listener. The results demonstrate that individual differences in perceptual cue weighting are modulated by the listener's gender and his/her subjective evaluation of the talker. These findings lend support for exemplar-based models of speech perception and production where socio-indexical features are encoded as a part of the episodic traces in the listeners' mental lexicon. This study also shed light on the relationship between individual variation in cue weighting and community-level sound change by demonstrating that VOT and onset F0 co-variation in North American English has acquired a certain degree of socio-indexical significance.more » « less
-
This dissertation compared speech perception across younger and older normal-hearing adults. We ask four research questions to assess acoustic cue weighting and the role of contextual information (lexical information and speaking rate) in speech perception. Experiment 1 tested for age-related changes in cue-weighting. The absolute weights showed that older listeners relied on both VOT and F0 more than younger listeners, and some listeners’ reliance on VOT correlated with inhibitory control when perceiving the /d/-/t/ contrast. The relative weights suggested that older listeners relied on VOT less and F0 more than younger listeners. Experiment 2 tested whether younger and older listeners used different cue-weighting adjustment strategies in distributional learning. Both older and younger listeners adjusted their reliance on acoustic cues when the primary acoustic cue (VOT) became ambiguous. Older listeners adjusted F0 to a greater degree than younger listeners, while younger listeners adjusted VOT more than older listeners. With a lexically-guided learning paradigm, Experiment 3 explored if younger and older adults differed in their use of lexical information when learning to map acoustic tokens that were ambiguous. Older and younger listeners utilized the lexical context to the same extent. In Experiment 4, the contextual effect of speaking rate was examined by embedding voicing contrasts in short and long syllables and presenting these syllables to younger and older listeners. Older and younger listeners compensated for variation in speaking rate in a similar manner as younger listeners. The findings in perceptual learning demonstrate perceptual flexibility among normal-hearing older listeners, despite an assumed decline in temporal processing.more » « less
An official website of the United States government

