skip to main content


The NSF Public Access Repository (NSF-PAR) system and access will be unavailable from 5:00 PM ET until 11:00 PM ET on Friday, June 21 due to maintenance. We apologize for the inconvenience.

This content will become publicly available on December 1, 2024

Title: Configuration of the action observation network depends on the goals of the observer
Observing the actions of others engages a core action observation network (AON) that includes the bilateral inferior frontal cortex (IFC), posterior superior temporal sulcus (pSTS) and inferior parietal lobule (IPL) (Caspers et al., 2010). Each region in the AON has functional properties that are heterogeneous and include representing the perceptual properties of action, predicting action outcomes and making inferences as to the goals of the actor. Critically, recent evidence shows that neural representations within the pSTS are sharpened when attending to the kinematics of the actor, such that the top-down guided attention reshapes underlying neural representations. In this study we evaluate how attention alters network connectivity within the AON as a system. Cues directed participant's attention to the goal, kinematics, or identity depicted in short action animations while brain responses were measured by fMRI. We identified those parcels within the AON with functional connectivity modulated by task. Results show that connectivity between the right pSTS and right IFC, and bilateral extended STS (STS+) were modulated during action observation such that connections were strengthened when the participant was attending to the action than goal. This finding is contrasted by the univariate results, which no univariate modulations in these brain regions except for right IFC. Using the functional networks defined by Yeo et al. (2011), we identified the parcels that are modulated by the attention to consist mainly of the fronto-parietal control network and default mode networks. These results are consistent with models of top-down feedback from executive system in the IFC to pSTS and implicates a right lateralized dual pathway model for action observation when focused on whole-body kinematics.  more » « less
Award ID(s):
1658278 1658560
Author(s) / Creator(s):
; ; ;
Publisher / Repository:
Date Published:
Journal Name:
Page Range / eLocation ID:
Subject(s) / Keyword(s):
["Action observation","Action observation network","fMRI","Mirror neuron system","Functional connectivity"]
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. Abstract

    The posterior superior temporal sulcus (pSTS) is a brain region characterized by perceptual representations of human body actions that promote the understanding of observed behavior. Increasingly, action observation is recognized as being strongly shaped by the expectations of the observer (Kilner 2011; Koster-Hale and Saxe 2013; Patel et al. 2019). Therefore, to characterize top-down influences on action observation, we evaluated the statistical structure of multivariate activation patterns from the action observation network (AON) while observers attended to the different dimensions of action vignettes (the action kinematics, goal, or identity of avatars jumping or crouching). Decoding accuracy varied as a function of attention instruction in the right pSTS and left inferior frontal cortex (IFC), with the right pSTS classifying actions most accurately when observers attended to the action kinematics and the left IFC classifying most accurately when observed attended to the actor’s goal. Functional connectivity also increased between the right pSTS and right IFC when observers attended to the actions portrayed in the vignettes. Our findings are evidence that the attentive state of the viewer modulates sensory representations in the pSTS, consistent with proposals that the pSTS occupies an interstitial zone mediating top-down context and bottom-up perceptual cues during action observation.

    more » « less
  2. Abstract

    A growing body of evidence suggests that in adults, there is a spatially consistent “inferior temporal numeral area” (ITNA) in the occipitotemporal cortex that appears to preferentially process Arabic digits relative to non-numerical symbols and objects. However, very little is known about why the ITNA is spatially segregated from regions that process other orthographic stimuli such as letters, and why it is spatially consistent across individuals. In the present study, we used diffusion-weighted imaging and functional magnetic resonance imaging to contrast structural and functional connectivity between left and right hemisphere ITNAs and a left hemisphere letter-preferring region. We found that the left ITNA had stronger structural and functional connectivity than the letter region to inferior parietal regions involved in numerical magnitude representation and arithmetic. Between hemispheres, the left ITNA showed stronger structural connectivity with the left inferior frontal gyrus (Broca’s area), while the right ITNA showed stronger structural connectivity to the ipsilateral inferior parietal cortex and stronger functional coupling with the bilateral IPS. Based on their relative connectivity, our results suggest that the left ITNA may be more readily involved in mapping digits to verbal number representations, while the right ITNA may support the mapping of digits to quantity representations.

    more » « less
  3. Abstract

    The ability to execute a motor plan involves spatiotemporally precise oscillatory activity in primary motor (M1) regions, in concert with recruitment of “higher order” attentional mechanisms for orienting toward current task goals. While current evidence implicates gamma oscillatory activity in M1 as central to the execution of a movement, far less is known about top‐down attentional modulation of this response. Herein, we utilized magnetoencephalography (MEG) during a Posner attention‐reorienting task to investigate top‐down modulation of M1 gamma responses by frontal attention networks in 63 healthy adult participants. MEG data were evaluated in the time–frequency domain and significant oscillatory responses were imaged using a beamformer. Robust increases in theta activity were found in bilateral inferior frontal gyri (IFG), with significantly stronger responses evident in trials that required attentional reorienting relative to those that did not. Additionally, strong gamma oscillations (60–80 Hz) were detected in M1 during movement execution, with similar responses elicited irrespective of attentional reorienting. Whole‐brain voxel‐wise correlations between validity difference scores (i.e., attention reorienting trials—nonreorienting trials) in frontal theta activity and movement‐locked gamma oscillations revealed a robust relationship in the contralateral sensorimotor cortex, supplementary motor area, and right cerebellum, suggesting modulation of these sensorimotor network gamma responses by attentional reorienting. Importantly, the validity difference effect in this distributed motor network was predictive of overall motor function measured outside the scanner and further, based on a mediation analysis this relationship was fully mediated by the reallocation response in the right IFG. These data are the first to characterize the top‐down modulation of movement‐related gamma responses during attentional reorienting and movement execution.

    more » « less
  4. Abstract

    Processing facial expressions of emotion draws on a distributed brain network. In particular, judging ambiguous facial emotions involves coordination between multiple brain areas. Here, we applied multimodal functional connectivity analysis to achieve network-level understanding of the neural mechanisms underlying perceptual ambiguity in facial expressions. We found directional effective connectivity between the amygdala, dorsomedial prefrontal cortex (dmPFC), and ventromedial PFC, supporting both bottom-up affective processes for ambiguity representation/perception and top-down cognitive processes for ambiguity resolution/decision. Direct recordings from the human neurosurgical patients showed that the responses of amygdala and dmPFC neurons were modulated by the level of emotion ambiguity, and amygdala neurons responded earlier than dmPFC neurons, reflecting the bottom-up process for ambiguity processing. We further found parietal-frontal coherence and delta-alpha cross-frequency coupling involved in encoding emotion ambiguity. We replicated the EEG coherence result using independent experiments and further showed modulation of the coherence. EEG source connectivity revealed that the dmPFC top-down regulated the activities in other brain regions. Lastly, we showed altered behavioral responses in neuropsychiatric patients who may have dysfunctions in amygdala-PFC functional connectivity. Together, using multimodal experimental and analytical approaches, we have delineated a neural network that underlies processing of emotion ambiguity.

    more » « less
  5. Abstract

    Reading entails transforming visual symbols to sound and meaning. This process depends on specialized circuitry in the visual cortex, the visual word form area (VWFA). Recent findings suggest that this text‐selective cortex comprises at least two distinct subregions: the more posterior VWFA‐1 is sensitive to visual features, while the more anterior VWFA‐2 processes higher level language information. Here, we explore whether these two subregions also exhibit different patterns of functional connectivity. To this end, we capitalize on two complementary datasets: Using the Natural Scenes Dataset (NSD), we identify text‐selective responses in high‐quality 7T adult data (N = 8), and investigate functional connectivity patterns of VWFA‐1 and VWFA‐2 at the individual level. We then turn to the Healthy Brain Network (HBN) database to assess whether these patterns replicate in a large developmental sample (N = 224; age 6–20 years), and whether they relate to reading development. In both datasets, we find that VWFA‐1 is primarily correlated with bilateral visual regions. In contrast, VWFA‐2 is more strongly correlated with language regions in the frontal and lateral parietal lobes, particularly the bilateral inferior frontal gyrus. Critically, these patterns do not generalize to adjacent face‐selective regions, suggesting a specific relationship between VWFA‐2 and the frontal language network. No correlations were observed between functional connectivity and reading ability. Together, our findings support the distinction between subregions of the VWFA, and suggest that functional connectivity patterns in the ventral temporal cortex are consistent over a wide range of reading skills.

    more » « less