Deep Face Decoder: Towards understanding the embedding space of convolutional networks through visual reconstruction of deep face templates
- Award ID(s):
- 1650503
- PAR ID:
- 10577454
- Publisher / Repository:
- Elsevier
- Date Published:
- Journal Name:
- Engineering Applications of Artificial Intelligence
- Volume:
- 132
- Issue:
- C
- ISSN:
- 0952-1976
- Page Range / eLocation ID:
- 107941
- Format(s):
- Medium: X
- Sponsoring Org:
- National Science Foundation
More Like this
-
null (Ed.)People with superior face recognition have relatively thin cortex in face-selective brain areas, whereas those with superior vehicle recognition have relatively thick cortex in the same areas. We suggest that these opposite correlations reflect distinct mechanisms influencing cortical thickness (CT) as abilities are acquired at different points in development. We explore a new prediction regarding the specificity of these effects through the depth of the cortex: that face recognition selectively and negatively correlates with thickness of the deepest laminar subdivision in face-selective areas. With ultrahigh resolution MRI at 7T, we estimated the thickness of three laminar subdivisions, which we term “MR layers,” in the right fusiform face area (FFA) in 14 adult male humans. Face recognition was negatively associated with the thickness of deep MR layers, whereas vehicle recognition was positively related to the thickness of all layers. Regression model comparisons provided overwhelming support for a model specifying that the magnitude of the association between face recognition and CT differs across MR layers (deep vs. superficial/middle) whereas the magnitude of the association between vehicle recognition and CT is invariant across layers. The total CT of right FFA accounted for 69% of the variance in face recognition, and thickness of the deep layer alone accounted for 84% of this variance. Our findings demonstrate the functional validity of MR laminar estimates in FFA. Studying the structural basis of individual differences for multiple abilities in the same cortical area can reveal effects of distinct mechanisms that are not apparent when studying average variation or development.more » « less
-
Recent neural evidence challenges the traditional view that face identity and facial expressions are processed by segregated neural pathways, showing that information about identity and expression are encoded within common brain regions. This article tests the hypothesis that integrated representations of identity and expression arise naturally within neural networks. Deep networks trained to recognize expression and deep networks trained to recognize identity spontaneously develop representations of identity and expression, respectively. These findings serve as a “proof-of-concept” that it is not necessary to discard task-irrelevant information for identity and expression recognition.more » « less
An official website of the United States government

