skip to main content

Title: Neural Interactions Underlying Visuomotor Associations in the Human Brain

Rapid and flexible learning during behavioral choices is critical to our daily endeavors and constitutes a hallmark of dynamic reasoning. An important paradigm to examine flexible behavior involves learning new arbitrary associations mapping visual inputs to motor outputs. We conjectured that visuomotor rules are instantiated by translating visual signals into actions through dynamic interactions between visual, frontal and motor cortex. We evaluated the neural representation of such visuomotor rules by performing intracranial field potential recordings in epilepsy subjects during a rule-learning delayed match-to-behavior task. Learning new visuomotor mappings led to the emergence of specific responses associating visual signals with motor outputs in 3 anatomical clusters in frontal, anteroventral temporal and posterior parietal cortex. After learning, mapping selective signals during the delay period showed interactions with visual and motor signals. These observations provide initial steps towards elucidating the dynamic circuits underlying flexible behavior and how communication between subregions of frontal, temporal, and parietal cortex leads to rapid learning of task-relevant choices.

 ;  ;  ;  ;  ;  ;  ;  
Publication Date:
Journal Name:
Cerebral Cortex
Page Range or eLocation-ID:
p. 4551-4567
Oxford University Press
Sponsoring Org:
National Science Foundation
More Like this
  1. Abstract

    Conflicts at various stages of cognition can cause interference effects on behavior. Two well-studied forms of cognitive interference are stimulus–stimulus (e.g., Flanker), where the conflict arises from incongruence between the task-relevant stimulus and simultaneously presented irrelevant stimulus information, and stimulus-response (e.g., Simon), where interference is the result of an incompatibility between the spatial location of the task-relevant stimulus and a prepotent motor mapping of the expected response. Despite substantial interest in the neural and behavioral underpinnings of cognitive interference, it remains uncertain how differing sources of cognitive conflict might interact, and the spectrally specific neural dynamics that index this phenomenon are poorly understood. Herein, we used an adapted version of the multisource interference task and magnetoencephalography to investigate the spectral, temporal, and spatial dynamics of conflict processing in healthy adults (N = 23). We found a double-dissociation such that, in isolation, stimulus–stimulus interference was indexed by alpha (8–14 Hz), but not gamma-frequency (64–76 Hz) oscillations in the lateral occipital regions, while stimulus–response interference was indexed by gamma oscillations in nearby cortices, but not by alpha oscillations. Surprisingly, we also observed a superadditive effect of simultaneously presented interference types (multisource) on task performance and gamma oscillations in superior parietal cortex.

  2. Many goal-directed actions that require rapid visuomotor planning and perceptual decision-making are affected in older adults, causing difficulties in execution of many functional activities of daily living. Visuomotor planning and perceptual identification are mediated by the dorsal and ventral visual streams, respectively, but it is unclear how age-induced changes in sensory processing in these streams contribute to declines in visuomotor decision-making performance. Previously, we showed that in young adults, task demands influenced movement strategies during visuomotor decision-making, reflecting differential integration of sensory information between the two streams. Here, we asked the question if older adults would exhibit deficits in interactions between the two streams during demanding motor tasks. Older adults ( n = 15) and young controls ( n = 26) performed reaching or interception movements toward virtual objects. In some blocks of trials, participants also had to select an appropriate movement goal based on the shape of the object. Our results showed that older adults corrected fewer initial decision errors during both reaching and interception movements. During the interception decision task, older adults made more decision- and execution-related errors than young adults, which were related to early initiation of their movements. Together, these results suggest that older adults havemore »a reduced ability to integrate new perceptual information to guide online action, which may reflect impaired ventral-dorsal stream interactions. NEW & NOTEWORTHY Older adults show declines in vision, decision-making, and motor control, which can lead to functional limitations. We used a rapid visuomotor decision task to examine how these deficits may interact to affect task performance. Compared with healthy young adults, older adults made more errors in both decision-making and motor execution, especially when the task required intercepting moving targets. This suggests that age-related declines in integrating perceptual and motor information may contribute to functional deficits.« less
  3. Environmental change can lead decision makers to shift rapidly among different behavioral regimes. These behavioral shifts can be accompanied by rapid changes in the firing pattern of neural networks. However, it is unknown what the populations of neurons that participate in such “network reset” phenomena are representing. Here, we investigated the following: (1) whether and where rapid changes in multivariate activity patterns are observable with fMRI during periods of rapid behavioral change and (2) what types of representations give rise to these phenomena. We did so by examining fluctuations in multivoxel patterns of BOLD activity from male and female human subjects making sequential inferences about the state of a partially observable and discontinuously changing variable. We found that, within the context of this sequential inference task, the multivariate patterns of activity in a number of cortical regions contain representations that change more rapidly during periods of uncertainty following a change in behavioral context. In motor cortex, this phenomenon was indicative of discontinuous change in behavioral outputs, whereas in visual regions, the same basic phenomenon was evoked by tracking of salient environmental changes. In most other cortical regions, including dorsolateral prefrontal and anterior cingulate cortex, the phenomenon was most consistent withmore »directly encoding the degree of uncertainty. However, in a few other regions, including orbitofrontal cortex, the phenomenon was best explained by representations of a shifting context that evolve more rapidly during periods of rapid learning. These representations may provide a dynamic substrate for learning that facilitates rapid disengagement from learned responses during periods of change.« less
  4. Classical studies of attention have identified areas of parietal and frontal cortex as sources of attentional control. Recently, a ventral region in the macaque temporal cortex, the posterior infero-temporal dorsal area PITd, has been suggested as a third attentional control area. This raises the question of whether and how spatially distant areas coordinate a joint focus of attention. Here we tested the hypothesis that parieto-frontal attention areas and PITd are directly interconnected. By combining functional MRI with ex-vivo high-resolution diffusion MRI, we found that PITd and dorsal attention areas are all directly connected through three specific fascicles. These results ascribe a new function, the communication of attention signals, to two known fiber-bundles, highlight the importance of vertical interactions across the two visual streams, and imply that the control of endogenous attention, hitherto thought to reside in macaque dorsal cortical areas, is exerted by a dorso-ventral network.
  5. Handwriting is a complex visual-motor skill that affects early reading development. A large body of work has demonstrated that handwriting is supported by a widespread neural system comprising ventral-temporal, parietal, and frontal motor regions in adults. Recent work has demonstrated that this neural system is largely established by 8 years of age, suggesting that the development of this system occurs in young children who are still learning to read and write. We made use of a novel MRI-compatible writing tablet that allowed us to measure brain activation in 5–8-year-old children during handwriting. We compared activation during handwriting in children and adults to provide information concerning the developmental trajectory of the neural system that supports handwriting. We found that parietal and frontal motor involvement during handwriting in children is different from adults, suggesting that the neural system that supports handwriting changes over the course of development. Furthermore, we found that parietal and frontal motor activation correlated with a literacy composite score in our child sample, suggesting that the individual differences in the dorsal response during handwriting are related to individual differences in emerging literacy skills. Our results suggest that components of the widespread neural system supporting handwriting develop at different ratesmore »and provide insight into the mechanisms underlying the contributions of handwriting to early literacy development.« less