skip to main content

Title: Cortical encoding of melodic expectations in human temporal cortex
Humans engagement in music rests on underlying elements such as the listeners’ cultural background and interest in music. These factors modulate how listeners anticipate musical events, a process inducing instantaneous neural responses as the music confronts these expectations. Measuring such neural correlates would represent a direct window into high-level brain processing. Here we recorded cortical signals as participants listened to Bach melodies. We assessed the relative contributions of acoustic versus melodic components of the music to the neural signal. Melodic features included information on pitch progressions and their tempo, which were extracted from a predictive model of musical structure based on Markov chains. We related the music to brain activity with temporal response functions demonstrating, for the first time, distinct cortical encoding of pitch and note-onset expectations during naturalistic music listening. This encoding was most pronounced at response latencies up to 350 ms, and in both planum temporale and Heschl’s gyrus.
Authors:
; ; ; ; ; ; ; ;
Award ID(s):
1824198
Publication Date:
NSF-PAR ID:
10189742
Journal Name:
eLife
Volume:
9
ISSN:
2050-084X
Sponsoring Org:
National Science Foundation
More Like this
  1. Musical imagery is the voluntary internal hearing of music in the mind without the need for physical action or external stimulation. Numerous studies have already revealed brain areas activated during imagery. However, it remains unclear to what extent imagined music responses preserve the detailed temporal dynamics of the acoustic stimulus envelope and, crucially, whether melodic expectations play any role in modulating responses to imagined music, as they prominently do during listening. These modulations are important as they reflect aspects of the human musical experience, such as its acquisition, engagement, and enjoyment. This study explored the nature of these modulations inmore »imagined music based on EEG recordings from 21 professional musicians (6 females and 15 males). Regression analyses were conducted to demonstrate that imagined neural signals can be predicted accurately, similarly to the listening task, and were sufficiently robust to allow for accurate identification of the imagined musical piece from the EEG. In doing so, our results indicate that imagery and listening tasks elicited an overlapping but distinctive topography of neural responses to sound acoustics, which is in line with previous fMRI literature. Melodic expectation, however, evoked very similar frontal spatial activation in both conditions, suggesting that they are supported by the same underlying mechanisms. Finally, neural responses induced by imagery exhibited a specific transformation from the listening condition, which primarily included a relative delay and a polarity inversion of the response. This transformation demonstrates the top-down predictive nature of the expectation mechanisms arising during both listening and imagery.« less
  2. During music listening, humans routinely acquire the regularities of the acoustic sequences and use them to anticipate and interpret the ongoing melody. Specifically, in line with this predictive framework, it is thought that brain responses during such listening reflect a comparison between the bottom-up sensory responses and top-down prediction signals generated by an internal model that embodies the music exposure and expectations of the listener. To attain a clear view of these predictive responses, previous work has eliminated the sensory inputs by inserting artificial silences (or sound omissions) that leave behind only the corresponding predictions of the thwarted expectations. Here,more »we demonstrate a new alternate approach in which we decode the predictive electroencephalography (EEG) responses to the silent intervals that are naturally interspersed within the music. We did this as participants (experiment 1, 20 participants, 10 female; experiment 2, 21 participants, 6 female) listened or imagined Bach piano melodies. Prediction signals were quantified and assessed via a computational model of the melodic structure of the music and were shown to exhibit the same response characteristics when measured during listening or imagining. These include an inverted polarity for both silence and imagined responses relative to listening, as well as response magnitude modulations that precisely reflect the expectations of notes and silences in both listening and imagery conditions. These findings therefore provide a unifying view that links results from many previous paradigms, including omission reactions and the expectation modulation of sensory responses, all in the context of naturalistic music listening.« less
  3. Although people across multiple cultures have been shown to experience music narratively, it has proven difficult to disentangle whether narrative dimensions of music derive from learned extramusical associations within a culture or from less experience-dependent elements of the music, such as musical contrast. Toward this end, two experiments investigated factors contributing to listeners’ narrative engagement with music, comparing the narrative experiences of Western and Chinese instrumental music for listeners in two suburban locations in the United States with those of listeners living in a remote rural village in China with different patterns of musical exposure. Supporting an enculturation perspective wheremore »learned extramusical associations (i.e., Topicality) play an important role in narrative perceptions of music, results from the first experiment show that for Western listeners, greater Topicality, rather than greater Contrast, increases narrative engagement, as long as listeners have sufficient exposure to its patterns of use within a culture. Strengthening this interpretation, results for the second experiment, which directly manipulated Topicality and Contrast, show that reducing an excerpt’s Topicality, but not its Contrast reduces listeners’ narrative engagement.« less
  4. This paper presents a deep reinforcement learning algorithm for online accompaniment generation, with potential for real-time interactive human-machine duet improvisation. Different from offline music generation and harmonization, online music accompaniment requires the algorithm to respond to human input and generate the machine counterpart in a sequential order. We cast this as a reinforcement learning problem, where the generation agent learns a policy to generate a musical note (action) based on previously generated context (state). The key of this algorithm is the well-functioning reward model. Instead of defining it using music composition rules, we learn this model from monophonic and polyphonicmore »training data. This model considers the compatibility of the machine-generated note with both the machine-generated context and the human-generated context. Experiments show that this algorithm is able to respond to the human part and generate a melodic, harmonic and diverse machine part. Subjective evaluations on preferences show that the proposed algorithm generates music pieces of higher quality than the baseline method.« less
  5. Abstract

    There is growing evidence for the efficacy of music, specifically Mozart’s Sonata for Two Pianos in D Major (K448), at reducing ictal and interictal epileptiform activity. Nonetheless, little is known about the mechanism underlying this beneficial “Mozart K448 effect” for persons with epilepsy. Here, we measured the influence that K448 had on intracranial interictal epileptiform discharges (IEDs) in sixteen subjects undergoing intracranial monitoring for refractory focal epilepsy. We found reduced IEDs during the original version of K448 after at least 30-s of exposure. Nonsignificant IED rate reductions were witnessed in all brain regions apart from the bilateral frontal cortices,more »where we observed increased frontal theta power during transitions from prolonged musical segments. All other presented musical stimuli were associated with nonsignificant IED alterations. These results suggest that the “Mozart K448 effect” is dependent on the duration of exposure and may preferentially modulate activity in frontal emotional networks, providing insight into the mechanism underlying this response. Our findings encourage the continued evaluation of Mozart’s K448 as a noninvasive, non-pharmacological intervention for refractory epilepsy.

    « less