skip to main content


Title: Holistic face recognition is an emergent phenomenon of spatial processing in face-selective regions
Spatial processing by receptive fields is a core property of the visual system. However, it is unknown how spatial processing in high-level regions contributes to recognition behavior. As face inversion is thought to disrupt typical holistic processing of information in faces, we mapped population receptive fields (pRFs) with upright and inverted faces in the human visual system. Here we show that in face-selective regions, but not primary visual cortex, pRFs and overall visual field coverage are smaller and shifted downward in response to face inversion. From these measurements, we successfully predict the relative behavioral detriment of face inversion at different positions in the visual field. This correspondence between neural measurements and behavior demonstrates how spatial processing in face-selective regions may enable holistic perception. These results not only show that spatial processing in high-level visual regions is dynamically used towards recognition, but also suggest a powerful approach for bridging neural computations by receptive fields to behavior.  more » « less
Award ID(s):
1756035
PAR ID:
10324999
Author(s) / Creator(s):
Date Published:
Journal Name:
Nature communications
Volume:
12
Issue:
1
ISSN:
2041-1723
Page Range / eLocation ID:
4745
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. Abstract

    Spatial processing by receptive fields is a core property of the visual system. However, it is unknown how spatial processing in high-level regions contributes to recognition behavior. As face inversion is thought to disrupt typical holistic processing of information in faces, we mapped population receptive fields (pRFs) with upright and inverted faces in the human visual system. Here we show that in face-selective regions, but not primary visual cortex, pRFs and overall visual field coverage are smaller and shifted downward in response to face inversion. From these measurements, we successfully predict the relative behavioral detriment of face inversion at different positions in the visual field. This correspondence between neural measurements and behavior demonstrates how spatial processing in face-selective regions may enable holistic perception. These results not only show that spatial processing in high-level visual regions is dynamically used towards recognition, but also suggest a powerful approach for bridging neural computations by receptive fields to behavior.

     
    more » « less
  2. While spatial information and biases have been consistently reported in high-level face regions, the functional contribution of this information toward face recognition behavior is unclear. Here, we propose that spatial integration of information plays a critical role in a hallmark phenomenon of face perception: holistic processing, or the tendency to process all features of a face concurrently rather than independently. We sought to gain insight into the neural basis of face recognition behavior by using a voxelwise encoding model of spatial selectivity to characterize the human face network using both typical face stimuli, and stimuli thought to disrupt normal face perception. We mapped population receptive fields (pRFs) using 3T fMRI in 6 participants using upright as well as inverted faces, which are thought to disrupt holistic processing. Compared to upright faces, inverted faces yielded substantial differences in measured pRF size, position, and amplitude. Further, these differences increased in magnitude along the face network hierarchy, from IOG- to pFus- and mFus-faces. These data suggest that pRFs in high-level regions reflect complex stimulus- dependent neural computations that underlie variations in recognition performance. 
    more » « less
  3. Abstract. Scientific fields that are interested in faces have developed their own sets of concepts and procedures for understanding how a tar- get model system (be it a person or algorithm) perceives a face under varying conditions. In computer vision, this has largely been in the form of dataset evaluation for recognition tasks where summary statistics are used to measure progress. While aggregate performance has continued to improve, understanding individual causes of failure has been difficult, as it is not always clear why a particular face fails to be recognized, or why an impostor is recognized by an algorithm. Importantly, other fields studying vision have addressed this via the use of visual psychophysics: the controlled manipulation of stimuli and careful study of the responses they evoke in a model system. In this paper, we suggest that visual psychophysics is a viable methodology for making face recognition algo- rithms more explainable. A comprehensive set of procedures is developed for assessing face recognition algorithm behavior, which is then deployed over state-of-the-art convolutional neural networks and more basic, yet still widely used, shallow and handcrafted feature-based approaches. 
    more » « less
  4. Abstract

    What role does experience play in the development of face recognition? A growing body of evidence indicates that newborn brains need slowly changing visual experiences to develop accurate visual recognition abilities. All of the work supporting this “slowness constraint” on visual development comes from studies testing basic‐level object recognition. Here, we present the results of controlled‐rearing experiments that provide evidence for a slowness constraint on the development of face recognition, a prototypical subordinate‐level object recognition task. We found that (1) newborn chicks can rapidly develop view‐invariant face recognition and (2) the development of this ability relies on experience with slowly moving faces. When chicks were reared with quickly moving faces, they built distorted face representations that largely lacked invariance to viewpoint changes, effectively “breaking” their face recognition abilities. These results provide causal evidence that slowly changing visual experiences play a critical role in the development of face recognition, akin to basic‐level object recognition. Thus, face recognition is not a hardwired property of vision but is learned rapidly as the visual system adapts to the temporal structure of the animal's visual environment.

     
    more » « less
  5. Goal-directed visual attention is a fundamental cognitive process that enables animals to selectively focus on specific regions of the visual field while filtering out irrelevant information. However, given the domain specificity of social behaviors, it remains unclear whether attention to faces versus nonfaces recruits different neurocognitive processes. In this study, we simultaneously recorded activity from temporal and frontal nodes of the attention network while macaques performed a goal-directed visual search task. V4 and inferotemporal (IT) visual category-selective units, selected during cue presentation, discriminated fixations on targets and distractors during the search but were differentially engaged by face and house targets. V4 and IT category-selective units also encoded fixation transitions and search dynamics. Compared with distractors, fixations on targets reduced spike–LFP coherence within the temporal cortex. Importantly, target-induced desynchronization between the temporal and prefrontal cortices was only evident for face targets, suggesting that attention to faces differentially engaged the prefrontal cortex. We further revealed bidirectional theta influence between the temporal and prefrontal cortices using Granger causality, which was again disproportionate for faces. Finally, we showed that the search became more efficient with increasing target-induced desynchronization. Together, our results suggest domain specificity for attending to faces and an intricate interplay between visual attention and social processing neural networks.

     
    more » « less