More Like this

1. That Sounds Familiar: An Analysis of Phonetic Representations Transfer Across Languages

   https://doi.org/10.21437/Interspeech.2020-2513  

   Żelasko, Piotr; Moro-Velázquez, Laureano; Hasegawa-Johnson, Mark; Scharenborg, Odette; Dehak, Najim (October 2020, Interspeech)

   null (Ed.)

   Only a handful of the world’s languages are abundant with the resources that enable practical applications of speech processing technologies. One of the methods to overcome this problem is to use the resources existing in other languages to train a mul-tilingual automatic speech recognition (ASR) model, which, intuitively, should learn some universal phonetic representations.In this work, we focus on gaining a deeper understanding ofhow general these representations might be, and how individual phones are getting improved in a multilingual setting. To that end, we select a phonetically diverse set of languages, and perform a series of monolingual, multilingual and crosslingual (zero-shot) experiments. The ASR is trained to recognize the International Phonetic Alphabet (IPA) token sequences. We ob-serve significant improvements across all languages in the multilingual setting, and stark degradation in the crosslingual setting, where the model, among other errors, considers Javanese as a tone language. Notably, as little as 10 hours of the target language training data tremendously reduces ASR error rates.Our analysis uncovered that even the phones that are unique to a single language can benefit greatly from adding training data from other languages - an encouraging result for the low-resource speech community 

   more » « less
2. Advanced Second Language Learners of Mandarin Show Persistent Deficits for Lexical Tone Encoding in Picture-to-Word Form Matching

   https://doi.org/https://doi.org/10.3389/fcomm.2021.689423  

   Pelzl, Eric; Lau, Ellen; Guo, Taomei; DeKeyser, Robert (June 2021, Frontiers in communication)

   null (Ed.)

   People who grow up speaking a language without lexical tones typically find it difficult to master tonal languages after childhood. Accumulating research suggests that much of the challenge for these second language (L2) speakers has to do not with identification of the tones themselves, but with the bindings between tones and lexical units. The question that remains open is how much of these lexical binding problems are problems of encoding (incomplete knowledge of the tone-to-word relations) vs. retrieval (failure to access those relations in online processing). While recent work using lexical decision tasks suggests that both may play a role, one issue is that failure on a lexical decision task may reflect a lack of learner confidence about what is not a word, rather than non-native representation or processing of known words. Here we provide complementary evidence using a picture- phonology matching paradigm in Mandarin in which participants decide whether or not a spoken target matches a specific image, with concurrent event-related potential (ERP) recording to provide potential insight into differences in L1 and L2 tone processing strategies. As in the lexical decision case, we find that advanced L2 learners show a clear disadvantage in accurately identifying tone mismatched targets relative to vowel mismatched targets. We explore the contribution of incomplete/uncertain lexical knowledge to this performance disadvantage by examining individual data from an explicit tone knowledge post-test. Results suggest that explicit tone word knowledge and confidence explains some but not all of the errors in picture-phonology matching. Analysis of ERPs from correct trials shows some differences in the strength of L1 and L2 responses, but does not provide clear evidence toward differences in processing that could explain the L2 disadvantage for tones. In sum, these results converge with previous evidence from lexical decision tasks in showing that advanced L2 listeners continue to have difficulties with lexical tone recognition, and in suggesting that these difficulties reflect problems both in encoding lexical tone knowledge and in retrieving that knowledge in real time. 

   more » « less
3. Low tone bias during perception of period doubling

   https://doi.org/10.1121/10.0015927  

   Huang, Yaqian (October 2022, The Journal of the Acoustical Society of America)

   Period-doubled voice consists of two alternating periods with multiple frequencies and is often perceived as rough with an indeterminate pitch. Past pitch-matching studies in period-doubled voice found that the perceived pitch was lower as the degree of amplitude and frequency modulation between the two alternating periods increased. The perceptual outcome also differed across f0s and modulation types: a lower f0 prompted earlier identification of a lower pitch, and the matched pitch dropped more quickly in frequency- than amplitude-modulated tokens (Sun & Xu, 2002; Bergan & Titze, 2001). However, it is unclear how listeners perceive period doubling when identifying linguistic tones. In an artificial language learning paradigm, this study used resynthesized stimuli with alternating amplitudes and/or frequencies of varying degrees, based on a production study of period-doubled voice (Huang, 2022). Listeners were native speakers of English and Mandarin. We confirm the positive relationship between the modulation degree and the proportion of low tones heard, and find that frequency modulation biased listeners to choose more low-tone options than amplitude modulation. However, a higher f0 (300 Hz) leads to a low-tone percept in more amplitude-modulated tokens than a lower f0 (200 Hz). Both English and Mandarin listeners behaved similarly, suggesting that pitch perception during period doubling is not language-specific. Furthermore, period doubling is predicted to signal low tones in languages, even when the f0 is high. 

   more » « less
4. EVEN IN THE BEST-CASE SCENARIO L2 LEARNERS HAVE PERSISTENT DIFFICULTY PERCEIVING AND UTILIZING TONES IN MANDARIN: FINDINGS FROM BEHAVIORAL AND EVENT-RELATED POTENTIALS EXPERIMENTS

   https://doi.org/10.1017/S027226312000039X  

   Pelzl, Eric; Lau, Ellen F.; Guo, Taomei; DeKeyser, Robert (September 2020, Studies in Second Language Acquisition)

   null (Ed.)

   Abstract Lexical tones are widely believed to be a formidable learning challenge for adult speakers of nontonal languages. While difficulties—as well as rapid improvements—are well documented for beginning second language (L2) learners, research with more advanced learners is needed to understand how tone perception difficulties impact word recognition once learners have a substantial vocabulary. The present study narrows in on difficulties suggested in previous work, which found a dissociation in advanced L2 learners between highly accurate tone identification and largely inaccurate lexical decision for tone words. We investigate a “best-case scenario” for advanced L2 tone word processing by testing performance in nearly ideal listening conditions—with words spoken clearly and in isolation. Under such conditions, do learners still have difficulty in lexical decision for tone words? If so, is it driven by the quality of lexical representations or by L2 processing routines? Advanced L2 and native Chinese listeners made lexical decisions while an electroencephalogram was recorded. Nonwords had a first syllable with either a vowel or tone that differed from that of a common disyllabic word. As a group, L2 learners performed less accurately when tones were manipulated than when vowels were manipulated. Subsequent analyses showed that this was the case even in the subset of items for which learners showed correct and confident tone identification in an offline written vocabulary test. Event-related potential results indicated N400 effects for both nonword conditions in L1, but only vowel N400 effects in L2, with tone responses intermediate between those of real words and vowel nonwords. These results are evidence of the persistent difficulty most L2 learners have in using tones for online word recognition, and indicate it is driven by a confluence of factors related to both L2 lexical representations and processing routines. We suggest that this tone nonword difficulty has real-world implications for learners: It may result in many toneless word representations in their mental lexicons, and is likely to affect the efficiency with which they can learn new tone words. 

   more » « less
5. Judicial self fashioning: Rhetorical performance in Supreme Court opinions

   https://doi.org/10.1177/14614456241281142  

   Thalken, Rosamond Elizabeth; Mimno, David; Wilkens, Matthew (September 2024, Discourse Studies)

   Justices on the United States Supreme Court use rhetorical strategies to maintain institutional legitimacy. In the court opinion, a strategy called the monologic voice presents a flattering depiction of the Court. The monologic voice occurs through two tones, the individualistic and collective, which respectively maintain the Justices’ legitimacy through critique and the Court’s legitimacy through unification. We train large language models to identify these rhetorical features in 15,291 modern Supreme Court opinions, issued between 1946 and 2022. While the fraction of collective and individualistic tones has been relatively consistent between 1946 and 2022, the Rehnquist Court used the collective tone at a higher rate than any other Court. In recent terms, 2021 and 2022, we find suggestions of another rhetorical shift, as all Associate Justices of the Roberts Court, excluding Chief Justice Roberts, used the individualistic tone at a historically high rate. 

   more » « less