Representational geometry and connectivity-based studies offer complementary insights into neural information processing, but it is unclear how representations and networks interact to generate neural information. Using a multi-task fMRI dataset, we investigate the role of intrinsic connectivity in shaping diverse representational geometries across the human cortex. Activity flow modeling, which generates neural activity based on connectivity-weighted propagation from other regions, successfully recreated similarity structure and a compression-then-expansion pattern of task representation dimensionality. We introduce a novel measure, convergence, quantifying the degree to which connectivity converges onto target regions. As hypothesized, convergence corresponded with compression of representations and helped explain the observed compression-then-expansion pattern of task representation dimensionality along the cortical hierarchy. These results underscore the generative role of intrinsic connectivity in sculpting representational geometries and suggest that structured connectivity properties, such as convergence, contribute to representational transformations. By bridging representational geometry and connectivity-based frameworks, this work offers a more unified understanding of neural information processing and the computational relevance of brain architecture.
more »
« less
Relating Representational Geometry to Cortical Geometry in the Visual Cortex
A fundamental principle of neural representation is to minimize wiring length by spatially organizing neurons according to the frequency of their communication [Sterling and Laughlin, 2015]. A consequence is that nearby regions of the brain tend to represent similar content. This has been explored in the context of the visual cortex in recent works [Doshi and Konkle, 2023, Tong et al., 2023]. Here, we use the notion of cortical distance as a baseline to ground, evaluate, and interpret measures of representational distance. We compare several popular methods—both second-order methods (Representational Similarity Analysis, Centered Kernel Alignment) and first-order methods (Shape Metrics)—and calculate how well the representational distance reflects 2D anatomical distance along the visual cortex (the anatomical stress score). We evaluate these metrics on a large-scale fMRI dataset of human ventral visual cortex [Allen et al., 2022b], and observe that the 3 types of Shape Metrics produce representational-anatomical stress scores with the smallest variance across subjects, (Z score = -1.5), which suggests that first-order representational scores quantify the relationship between representational and cortical geometry in a way that is more invariant across different subjects. Our work establishes a criterion with which to compare methods for quantifying representational similarity with implications for studying the anatomical organization of high-level ventral visual cortex.
more »
« less
- Award ID(s):
- 2313150
- PAR ID:
- 10529187
- Publisher / Repository:
- NeurIPS Workshop on Unifying Representations
- Date Published:
- Format(s):
- Medium: X
- Sponsoring Org:
- National Science Foundation
More Like this
-
-
Abstract Neocortical computations underlying vision are performed by a distributed network of functionally specialized areas. Mouse visual cortex, a dense interareal network that exhibits hierarchical properties, comprises subnetworks interconnecting distinct processing streams. To determine the layout of the mouse visual hierarchy, we have evaluated the laminar patterns formed by interareal axonal projections originating in each of ten areas. Reciprocally connected pairs of areas exhibit feedforward/feedback relationships consistent with a hierarchical organization. Beta regression analyses, which estimate a continuous hierarchical distance measure, indicate that the network comprises multiple nonhierarchical circuits embedded in a hierarchical organization of overlapping levels. Single-unit recordings in anaesthetized mice show that receptive field sizes are generally consistent with the hierarchy, with the ventral stream exhibiting a stricter hierarchy than the dorsal stream. Together, the results provide an anatomical metric for hierarchical distance, and reveal both hierarchical and nonhierarchical motifs in mouse visual cortex.more » « less
-
How do life experiences impact cortical function? In people who are born blind, the “visual” cortices are recruited for nonvisual tasks such as Braille reading and sound localization (e.g., Collignon et al., 2011; Sadato et al., 1996). The mechanisms of this recruitment are not known. Do visual cortices have a latent capacity to respond to nonvisual information that is equal throughout the lifespan? Alternatively, is there a sensitive period of heightened plasticity that makes visual cortex repurposing possible during childhood? To gain insight into these questions, we leveraged naturalistic auditory stimuli to quantify and compare cross-modal responses congenitally blind (CB, n=22), adult-onset blind (vision loss >18 years-of-age, AB, n=14) and sighted (n=22) individuals. Participants listened to auditory excerpts from movies; a spoken narrative; and matched meaningless auditory stimuli (i.e., shuffled sentences, backwards speech) during fMRI scanning. These rich naturalistic stimuli made it possible to simultaneous engage a broad range of cognitive domains. We correlated the voxel-wise timecourses of different participants within each group. For all groups, all stimulus conditions induced synchrony in auditory cortex and for all groups only the narrative stimuli synchronized responses in higher-cognitive fronto-parietal and temporal regions. Inter-subject synchrony in visual cortices was high in the CB group for the movie and narrative stimuli but not for meaningless auditory controls. In contrast, visual cortex synchrony was equally low among AB and sighted blindfolded participants. Even many years of blindness in adulthood fail to enable responses to naturalistic auditory information in visual cortices of people who had sight as children. These findings suggest that cross-modal responses in visual cortex of people born blind reflect the plasticity of developing visual cortex during a sensitive period.more » « less
-
na (Ed.)During a critical period in development, spontaneous and evoked retinal activity shape visual pathways in an adaptive fashion. Interestingly, spontaneous activity is sufficient for spatial refinement of visual receptive fields (RFs) in superior colliculus (SC) and visual cortex (V1), but early visual experience is necessary to maintain inhibitory synapses and stabilize RFs in adulthood (Carrasco et al., 2005, 2011; Carrasco and Pallas, 2006; Balmer and Pallas, 2015a). In V1, BDNF and its high-affinity receptor TrkB are important for development of visual acuity, inhibition, and regulation of the critical period for ocular dominance plasticity (Hanover et al., 1999; Huang et al., 1999; Gianfranceschi et al., 2003). To examine the generality of this signaling pathway for visual system plasticity, the present study examined the role of TrkB signaling during the critical period for RF refinement in SC. Activating TrkB receptors during the critical period (P33–P40) in dark reared subjects produced normally refined RFs, and blocking TrkB receptors in light-exposed animals resulted in enlarged adult RFs like those in dark reared animals. We also report here that deprivation- or TrkB blockade-induced RF enlargement in adulthood impaired fear responses to looming overhead stimuli and negatively impacted visual acuity. Thus, early TrkB activation is both necessary and sufficient to maintain visual RF refinement, robust looming responses, and visual acuity in adulthood. These findings suggest a common signaling pathway exists for the maturation of inhibition between V1 and SC.more » « less
-
Abstract The lateral prefrontal cortex (LPFC) is an evolutionarily expanded region in humans that is critical for numerous complex functions, many of which are largely hominoid specific. Although recent work shows that the presence or absence of specific sulci in anterior LPFC is associated with cognitive performance across age groups, it is unknown whether the presence of these structures relates to individual differences in the functional organization of LPFC. To fill this gap in knowledge, we leveraged multimodal neuroimaging data from two samples encompassing 82 young adult humans (aged 22–36 years) and show that the dorsal and ventral components of the paraintermediate frontal sulcus, or pimfs, present distinct morphological (surface area), architectural (thickness and myelination), and functional (resting-state connectivity networks) properties. We further contextualize the pimfs components within classic and modern cortical parcellations. Taken together, the dorsal and ventral pimfs components mark transitions in LPFC anatomy and function, across metrics and parcellations. These results emphasize that the pimfs is a critical structure to consider when examining individual differences in the anatomical and functional organization of LPFC and suggest that future individual-level parcellations could benefit from incorporating sulcal anatomy when delineating LPFC cortical regions.more » « less
An official website of the United States government

