Search for: All records | NSF Public Access

Note: When clicking on a Digital Object Identifier (DOI) number, you will be taken to an external site maintained by the publisher. Some full text articles may not yet be available without a charge during the embargo (administrative interval).
What is a DOI Number?

Some links on this page may take you to non-federal websites. Their policies may differ from this site.

Formant Tracking by Combining Deep Neural Network and Linear Prediction

https://doi.org/10.1109/OJSP.2025.3530876

Kadiri, Sudarsana Reddy; Huang, Kevin; Hagedorn, Christina; Byrd, Dani; Alku, Paavo; Narayanan, Shrikanth (January 2025, IEEE Open Journal of Signal Processing)

Free, publicly-accessible full text available January 1, 2026
Direct articulatory observation reveals phoneme recognition performance characteristics of a self-supervised speech model

https://doi.org/10.1121/10.0034430

Shi, Xuan; Feng, Tiantian; Huang, Kevin; Kadiri, Sudarsana_Reddy; Lee, Jihwan; Lu, Yijing; Zhang, Yubin; Goldstein, Louis; Narayanan, Shrikanth (November 2024, JASA Express Letters)

Variability in speech pronunciation is widely observed across different linguistic backgrounds, which impacts modern automatic speech recognition performance. Here, we evaluate the performance of a self-supervised speech model in phoneme recognition using direct articulatory evidence. Findings indicate significant differences in phoneme recognition, especially in front vowels, between American English and Indian English speakers. To gain a deeper understanding of these differences, we conduct real-time MRI-based articulatory analysis, revealing distinct velar region patterns during the production of specific front vowels. This underscores the need to deepen the scientific understanding of self-supervised speech model variances to advance robust and inclusive speech technology.
more » « less
State-of-the-art speech production MRI protocol for new 0.55 Tesla scanners

https://doi.org/10.21437/Interspeech.2024-2263

Kumar, Prakash; Tian, Ye; Lim, Yongwan; Cui, Sophia X; Hagedorn, Christina; Byrd, Dani; Sinha, Uttam K; Narayanan, Shrikanth; Nayak, Krishna S (September 2024, ISCA)

Free, publicly-accessible full text available September 1, 2025
Analysis of articulatory setting for L1 and L2 English speakers using MRI data

https://doi.org/10.21437/Interspeech.2024-2175

Huang, Kevin; Goldberg, Jack; Goldstein, Louis; Narayanan, Shrikanth (September 2024, ISCA)

Free, publicly-accessible full text available September 1, 2025