skip to main content


Title: The Music of Silence: Part II: Music Listening Induces Imagery Responses
During music listening, humans routinely acquire the regularities of the acoustic sequences and use them to anticipate and interpret the ongoing melody. Specifically, in line with this predictive framework, it is thought that brain responses during such listening reflect a comparison between the bottom-up sensory responses and top-down prediction signals generated by an internal model that embodies the music exposure and expectations of the listener. To attain a clear view of these predictive responses, previous work has eliminated the sensory inputs by inserting artificial silences (or sound omissions) that leave behind only the corresponding predictions of the thwarted expectations. Here, we demonstrate a new alternate approach in which we decode the predictive electroencephalography (EEG) responses to the silent intervals that are naturally interspersed within the music. We did this as participants (experiment 1, 20 participants, 10 female; experiment 2, 21 participants, 6 female) listened or imagined Bach piano melodies. Prediction signals were quantified and assessed via a computational model of the melodic structure of the music and were shown to exhibit the same response characteristics when measured during listening or imagining. These include an inverted polarity for both silence and imagined responses relative to listening, as well as response magnitude modulations that precisely reflect the expectations of notes and silences in both listening and imagery conditions. These findings therefore provide a unifying view that links results from many previous paradigms, including omission reactions and the expectation modulation of sensory responses, all in the context of naturalistic music listening.  more » « less
Award ID(s):
1824198
NSF-PAR ID:
10309543
Author(s) / Creator(s):
; ;
Date Published:
Journal Name:
The journal of neuroscience
Volume:
41
Issue:
35
ISSN:
0270-6474
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. Musical imagery is the voluntary internal hearing of music in the mind without the need for physical action or external stimulation. Numerous studies have already revealed brain areas activated during imagery. However, it remains unclear to what extent imagined music responses preserve the detailed temporal dynamics of the acoustic stimulus envelope and, crucially, whether melodic expectations play any role in modulating responses to imagined music, as they prominently do during listening. These modulations are important as they reflect aspects of the human musical experience, such as its acquisition, engagement, and enjoyment. This study explored the nature of these modulations in imagined music based on EEG recordings from 21 professional musicians (6 females and 15 males). Regression analyses were conducted to demonstrate that imagined neural signals can be predicted accurately, similarly to the listening task, and were sufficiently robust to allow for accurate identification of the imagined musical piece from the EEG. In doing so, our results indicate that imagery and listening tasks elicited an overlapping but distinctive topography of neural responses to sound acoustics, which is in line with previous fMRI literature. Melodic expectation, however, evoked very similar frontal spatial activation in both conditions, suggesting that they are supported by the same underlying mechanisms. Finally, neural responses induced by imagery exhibited a specific transformation from the listening condition, which primarily included a relative delay and a polarity inversion of the response. This transformation demonstrates the top-down predictive nature of the expectation mechanisms arising during both listening and imagery. 
    more » « less
  2. Humans engagement in music rests on underlying elements such as the listeners’ cultural background and interest in music. These factors modulate how listeners anticipate musical events, a process inducing instantaneous neural responses as the music confronts these expectations. Measuring such neural correlates would represent a direct window into high-level brain processing. Here we recorded cortical signals as participants listened to Bach melodies. We assessed the relative contributions of acoustic versus melodic components of the music to the neural signal. Melodic features included information on pitch progressions and their tempo, which were extracted from a predictive model of musical structure based on Markov chains. We related the music to brain activity with temporal response functions demonstrating, for the first time, distinct cortical encoding of pitch and note-onset expectations during naturalistic music listening. This encoding was most pronounced at response latencies up to 350 ms, and in both planum temporale and Heschl’s gyrus. 
    more » « less
  3. Abstract

    Speech production involves the careful orchestration of sophisticated systems, yet overt speech errors rarely occur under naturalistic conditions. The present functional magnetic resonance imaging study sought neural evidence for internal error detection and correction by leveraging a tongue twister paradigm that induces the potential for speech errors while excluding any overt errors from analysis. Previous work using the same paradigm in the context of silently articulated and imagined speech production tasks has demonstrated forward predictive signals in auditory cortex during speech and presented suggestive evidence of internal error correction in left posterior middle temporal gyrus (pMTG) on the basis that this area tended toward showing a stronger response when potential speech errors are biased toward nonwords compared to words (Okada et al., 2018). The present study built on this prior work by attempting to replicate the forward prediction and lexicality effects in nearly twice as many participants but introduced novel stimuli designed to further tax internal error correction and detection mechanisms by biasing speech errors toward taboo words. The forward prediction effect was replicated. While no evidence was found for a significant difference in brain response as a function of lexical status of the potential speech error, biasing potential errors toward taboo words elicited significantly greater response in left pMTG than biasing errors toward (neutral) words. Other brain areas showed preferential response for taboo words as well but responded below baseline and were less likely to reflect language processing as indicated by a decoding analysis, implicating left pMTG in internal error correction.

     
    more » « less
  4. Abstract

    Music frequently elicits intense emotional responses, a phenomenon that has been scrutinized from multiple disciplines that span the sciences and arts. While most people enjoy music and find it rewarding, there is substantial individual variability in the experience and degree of music‐induced reward. Here, we review current work on the neural substrates of hedonic responses to music. In particular, we focus the present review on specific musical anhedonia, a selective lack of pleasure from music. Based on evidence from neuroimaging, neuropsychology, and brain stimulation studies, we derive a neuroanatomical model of the experience of pleasure during music listening. Our model posits that hedonic responses to music are the result of connectivity between structures involved in auditory perception as a predictive process, and those involved in the brain's dopaminergic reward system. We conclude with open questions and implications of this model for future research on why humans appreciate music.

     
    more » « less
  5. Abstract

    Listening to pleasurable music is known to engage the brain’s reward system. This has motivated many cognitive-behavioral interventions for healthy aging, but little is known about the effects of music-based intervention (MBI) on activity and connectivity of the brain’s auditory and reward systems. Here we show preliminary evidence that brain network connectivity can change after receptive MBI in cognitively unimpaired older adults. Using a combination of whole-brain regression, seed-based connectivity analysis, and representational similarity analysis (RSA), we examined fMRI responses during music listening in older adults before and after an 8-week personalized MBI. Participants rated self-selected and researcher-selected musical excerpts on liking and familiarity. Parametric effects of liking, familiarity, and selection showed simultaneous activation in auditory, reward, and default mode network (DMN) areas. Functional connectivity within and between auditory and reward networks was modulated by participant liking and familiarity ratings. RSA showed significant representations of selection and novelty at both time-points, and an increase in striatal representation of musical stimuli following intervention. An exploratory seed-based connectivity analysis comparing pre- and post-intervention showed significant increase in functional connectivity between auditory regions and medial prefrontal cortex (mPFC). Taken together, results show how regular music listening can provide an auditory channel towards the mPFC, thus offering a potential neural mechanism for MBI supporting healthy aging.

     
    more » « less