How does the brain organize our understanding of the objects we see? A common view is that the brain sorts objects into clear categories — faces, tools, places — with dedicated regions for each. But what if it works the other way around?

Here, we asked whether the brain instead represents objects along continuous dimensions that matter for behaviour. While previous work has mapped some of these dimensions to the brain (like real-world size), a complete model of how the brain represents the multidimensional nature of objects has been missing.

We took dimensions derived from large-scale human similarity judgments — how people spontaneously group and distinguish objects — and mapped them onto brain activity across the cortex using fMRI.

Linking large-scale brain and behavioral recordings
Fig 1 Linking brain and behavioral recordings in response to thousands of every-day objects. Contier et al., Nature Human Behaviour 2024 · CC BY 4.0

What we found

Result Behaviourally relevant dimensions are represented in a broadly distributed way across the human visual system — with mixed selectivity in many areas and sparser, dimension-specific tuning in some category-selective regions. This suggests that the entire visual system is involved in our understanding of objects.
66Object dimensions
1,854Object concepts
8,740Images, fMRI
4.7MSimilarity trials
Behaviour-related information about objects is widely distributed throughout the brain
Fig 2 Behaviour-related information about objects predicts neural activation across large parts of the brain. Contier et al., Nature Human Behaviour 2024 · CC BY 4.0

Why it matters

The findings suggest that object vision is organized around continuous, behaviourally relevant dimensions. This framework also helps reconcile ongoing debates about seemingly opposing views of how the brain represents objects — distinct regions vs. broader tuning maps.

More generally, this work puts forth an alternative approach for understanding the brain: focusing less on presupposed categories or visual features, and instead starting with human behaviour as a guiding principle for brain organization.

Read the paper Code Nature Human Behaviour