Each person experiences the world through a unique conceptual lens, shaped by personal experiences, natural variations, or disease. These individual differences have remained largely inaccessible to cognitive neuroscience and clinical neurology, limiting the development of precision medicine approaches to cognitive disorders. To overcome this limitation, here we develop a new statistical framework to measure and interpret individual differences in functional brain representations. We apply this framework to characterize how different individuals represent the same concepts. Twenty-four participants listened to narrative stories while their brain activity was measured with functional MRI (fMRI). Encoding models were used to recover how hundreds of concepts were represented in each person’s brain. Despite listening to identical stories, participants showed systematic individual differences in conceptual representations. These differences reveal person-specific biases in how concepts are represented in the brain. Individual variability was highest in regions that represent social information. Because these regions are thought to integrate sensory information with personal beliefs and experiences, the observed individual differences may reflect cognitive traits unique to each person. Our work reveals that individual differences are a systematic, measurable principle of conceptual representations in the human brain. By enabling researchers to measure and interpret differences in person-specific functional brain representations, our work establishes a new paradigm for precision neuroscience. This paradigm provides a rigorous foundation for developing fMRI applications in precision medicine to diagnose and monitor cognitive disorders.
Model connectivity: leveraging the power of encoding models to overcome the limitations of functional connectivity
Emily X Meschke*, Matteo Visconti di Oleggio Castello*, Tom Dupré la Tour, and Jack L. Gallant
Functional connectivity (FC) is the most popular method for recovering functional networks of brain areas with fMRI. However, because FC is defined as temporal correlations in brain activity, FC networks are confounded by noise and lack a precise functional role. To overcome these limitations, we developed model connectivity (MC). MC is defined as similarities in encoding model weights, which quantify reliable functional activity in terms of interpretable stimulus- or task-related features. To compare FC and MC, both methods were applied to a naturalistic story listening dataset. FC recovered spatially broad networks that are confounded by noise, and that lack a clear role during natural language comprehension. By contrast, MC recovered spatially localized networks that are robust to noise, and that represent distinct categories of semantic concepts. Thus, MC is a powerful data-driven approach for recovering and interpreting the functional networks that support complex cognitive processes.
Peer-reviewed publications
The Voxelwise Encoding Model framework: a tutorial introduction to fitting encoding models to fMRI data
Tom Dupré la Tour*, Matteo Visconti di Oleggio Castello*, and Jack L. Gallant
The Voxelwise Encoding Model framework (VEM) is a powerful approach for functional brain mapping. In the VEM framework, features are extracted from the stimulus (or task) and used in an encoding model to predict brain activity. If the encoding model is able to predict brain activity in some part of the brain, then one may conclude that some information represented in the features is also encoded in the brain. In VEM, a separate encoding model is fitted on each spatial sample (i.e., each voxel). VEM has many benefits compared to other methods for analyzing and modeling neuroimaging data. Most importantly, VEM can use large numbers of features simultaneously, which enables the analysis of complex naturalistic stimuli and tasks. Therefore, VEM can produce high-dimensional functional maps that reflect the selectivity of each voxel to large numbers of features. Moreover, because model performance is estimated on a separate test dataset not used during fitting, VEM minimizes overfitting and inflated Type I error confounds that plague other approaches, and the results of VEM generalize to new subjects and new stimuli. Despite these benefits, VEM is still not widely used in neuroimaging, partly because no tutorials on this method are available currently. To demystify the VEM framework and ease its dissemination, this paper presents a series of hands-on tutorials accessible to novice practitioners. The VEM tutorials are based on free open-source tools and public datasets, and reproduce the analysis presented in previously published work.
HeuDiConv—flexible DICOM conversion into structured directory layouts
Yaroslav O Halchenko, Mathias Goncalves, Satrajit Ghosh, Pablo Velasco, Matteo Visconti di Oleggio Castello, Taylor Salo, John T Wodder, Michael Hanke, Patrick Sadil, Krzysztof Jacek Gorgolewski, and others
Processes evoked by seeing a personally familiar face encompass recognition of visual appearance and activation of social and person knowledge. Whereas visual appearance is the same for all viewers, social and person knowledge may be more idiosyncratic. Using between-subject multivariate decoding of hyperaligned functional magnetic resonance imaging data, we investigated whether representations of personally familiar faces in different parts of the distributed neural system for face perception are shared across individuals who know the same people. We found that the identities of both personally familiar and merely visually familiar faces were decoded accurately across brains in the core system for visual processing, but only the identities of personally familiar faces could be decoded across brains in the extended system for processing nonvisual information associated with faces. Our results show that personal interactions with the same individuals lead to shared neural representations of both the seen and unseen features that distinguish their identities.
Hybrid Hyperalignment: A single high-dimensional model of shared information embedded in cortical patterns of response and functional connectivity
Erica L. Busch, Lukas Slipski, Ma Feilong, J. Swaroop Guntupalli, Matteo Visconti di Oleggio Castello, Jeremy F. Huckins, Samuel A. Nastase, M. Ida Gobbini, Tor D. Wager, and James V. Haxby
Personally familiar faces are processed more robustly and efficiently than unfamiliar faces. The human face processing system comprises a core system that analyzes the visual appearance of faces and an extended system for the retrieval of person-knowledge and other nonvisual information. We applied multivariate pattern analysis to fMRI data to investigate aspects of familiarity that are shared by all familiar identities and information that distinguishes specific face identities from each other. Both identity-independent familiarity information and face identity could be decoded in an overlapping set of areas in the core and extended systems. Representational similarity analysis revealed a clear distinction between the two systems and a subdivision of the core system into ventral, dorsal and anterior components. This study provides evidence that activity in the extended system carries information about both individual identities and personal familiarity, while clarifying and extending the organization of the core system for face perception.
Concurrent development of facial identity and expression discrimination
Kirsten A. Dalrymple, Matteo Visconti di Oleggio Castello, Jed T. Elison, and M. Ida Gobbini
Attention Selectively Reshapes the Geometry of Distributed Semantic Representation
Samuel A Nastase, Andrew C Connolly, Nikolaas N Oosterhof, Yaroslav O Halchenko, J Swaroop Guntupalli, Matteo Visconti di Oleggio Castello, Jason Gors, M Ida Gobbini, and James V Haxby
How the Human Brain Represents Perceived Dangerousness or “Predacity” of Animals
Andrew C Connolly, Long Sha, J Swaroop Guntupalli, Nikolaas Oosterhof, Yaroslav O Halchenko, Samuel A Nastase, Matteo Visconti di Oleggio Castello, Hervé Abdi, Barbara C Jobst, M Ida Gobbini, and James V Haxby