The brain of the beholder: honouring individual representational idiosyncrasies

References

• Aguirre, G. K. (2007). Continuous carry-over designs for fMRI. NeuroImage, 35, 1480–1494. doi:10.1016/j.neuroimage.2007.02.005
   PubMed Web of Science ®Google Scholar
• Cadieu, C. F., Hong, H., Yamins, D. L. K., Pinto, N., Ardila, D., Solomon, E. A., … DiCarlo, J. J. (2014). Deep neural networks rival the representation of primate IT cortex for core visual object recognition. ArXiv e-prints, 1406.3284.
   Google Scholar
• Chadwick, M. J., Bonnici, H. M., & Maguire, E. A. (2014). CA3 size predicts the precision of memory recall. Proceedings of the National Academy of Sciences, 111, 10720–10725. doi:10.1073/pnas.1319641111
   PubMed Web of Science ®Google Scholar
• Charest, I., Kievit, R. A., Schmitz, T. W., Deca, D., & Kriegeskorte, N. (2014). Unique semantic space in the brain of each beholder predicts perceived similarity. Proceedings of the National Academy of Sciences, 111, 14565–14570. doi:10.1073/pnas.1402594111
   PubMed Web of Science ®Google Scholar
• Cichy, R. M., Pantazis, D., & Oliva, A. (2014). Resolving human object recognition in space and time. Nature Neuroscience, 17, 455–462. doi:10.1038/nn.3635
   PubMed Web of Science ®Google Scholar
• Clarke, A., & Tyler, L. K. (2014). Object-specific semantic coding in human perirhinal cortex. Journal of Neuroscience, 34, 4766–4775. doi:10.1523/JNEUROSCI.2828-13.2014
   PubMed Web of Science ®Google Scholar
• Cole, M. W., Yarkoni, T., Repovs, G., Anticevic, A., & Braver, T. S. (2012). Global connectivity of prefrontal cortex predicts cognitive control and intelligence. Journal of Neuroscience, 32, 8988–8999. doi:10.1523/JNEUROSCI.0536-12.2012
   PubMed Web of Science ®Google Scholar
• Çukur, T., Nishimoto, S., Huth, A. G., & Gallant, J. L. (2013). Attention during natural vision warps semantic representation across the human brain. Nature Neuroscience, 16, 763–770. doi:10.1038/nn.3381
   PubMed Web of Science ®Google Scholar
• Dennett, D. C. (1989). The intentional stance. Cambridge, MA: The MIT Press.
   Google Scholar
• Downing, P. E. (2001). A cortical area selective for visual processing of the human body. Science, 293, 2470–2473. doi:10.1126/science.1063414
   PubMed Web of Science ®Google Scholar
• Dumoulin, S. O., & Wandell, B. A. (2008). Population receptive field estimates in human visual cortex. Neuroimage, 39, 647–660. doi:10.1016/j.neuroimage.2007.09.034
   PubMed Web of Science ®Google Scholar
• Epstein, R. A., & Kanwisher, N. (1998). A cortical representation of the local visual environment. Nature, 392, 598–601.
   PubMed Web of Science ®Google Scholar
• Fedorenko, E., Duncan, J., & Kanwisher, N. (2013). Broad domain generality in focal regions of frontal and parietal cortex. Proceedings of the National Academy of Sciences, 110, 16616–16621. doi:10.1073/pnas.1315235110
   PubMed Web of Science ®Google Scholar
• Fedorenko, E., Hsieh, P. J., Nieto-Castanon, A., Whitfield-Gabrieli, S., & Kanwisher, N. (2010). New method for fMRI investigations of language: Defining ROIs functionally in individual subjects. Journal of Neurophysiology, 104, 1177–1194. doi:10.1152/jn.00032.2010
   PubMed Web of Science ®Google Scholar
• Friston, K. J., Frith, C. D., Liddle, P. F., Dolan, R. J., Lammertsma, A. A., & Frackowiak, R. S. J. (1990). The relationship between global and local changes in PET scans. Journal of Cerebral Blood Flow & Metabolism, 10, 458–466. doi:10.1038/jcbfm.1990.88
   PubMed Web of Science ®Google Scholar
• Friston, K. J., Holmes, A. P., Worsley, K. J., Poline, J. B., Frith, C. D., & Frackowiak, R. S. J. (1994). Statistical parametric maps in functional imaging: A general linear approach. Human Brain Mapping, 2, 189–210. doi:10.1002/hbm.460020402
   Google Scholar
• Furl, N., Garrido, L., Dolan, R. J., Driver, J., & Duchaine, B. (2011). Fusiform gyrus face selectivity relates to individual differences in facial recognition ability. Journal of Cognitive Neuroscience, 23, 1723–1740. doi:10.1162/jocn.2010.21545
   PubMed Web of Science ®Google Scholar
• Gallistel, C. R. (1990). The organization of learning (viii, p. 648).Cambridge, MA: The MIT Press.
   Google Scholar
• Goldstone, R. (1994). An efficient method for obtaining similarity data. Behavior Research Methods, Instruments, & Computers, 26, 381–386. doi:10.3758/BF03204653
   Google Scholar
• Grandin, T., & Panek, R. (2014). The autistic brain: Helping different kinds of minds succeed. Boston, MA: Houghton Mifflin Harcourt.
   Google Scholar
• Grill-Spector, K., & Weiner, K. S. (2014). The functional architecture of the ventral temporal cortex and its role in categorization. Nature Reviews Neuroscience, 15, 536–548. doi:10.1038/nrn3747
   PubMed Web of Science ®Google Scholar
• Haar, S., Berman, S., Behrmann, M., & Dinstein, I. (2014). Anatomical abnormalities in autism? Cerebral Cortex. Advance online publication. doi:10.1093/cercor/bhu242
   Google Scholar
• Harel, A., Kravitz, D. J., & Baker, C. I. (2013). Deconstructing visual scenes in cortex: Gradients of object and spatial layout information. Cerebral Cortex, 23, 947–957. doi:10.1093/cercor/bhs091
   PubMed Web of Science ®Google Scholar
• Harel, A., Kravitz, D. J., & Baker, C. I. (2014). Task context impacts visual object processing differentially across the cortex. Proceedings of the National Academy of Sciences, 111, E962–E971. doi:10.1073/pnas.1312567111
   PubMed Web of Science ®Google Scholar
• Haxby, J. V., Gobbini, M. I., Furey, M. L., Ishai, A., Schouten, J. L., & Pietrini, P. (2001). Distributed and overlapping representations of faces and objects in ventral temporal cortex. Science, 293, 2425–2430. doi:10.1126/science.1063736
   PubMed Web of Science ®Google Scholar
• Haxby, J. V., Guntupalli, S. J., Connolly, A. C., Halchenko, Y. O., Conroy, B. R., Gobbini, M. I., … Ramadge, P. J. (2011). A common, high-dimensional model of the representational space in human ventral temporal cortex. Neuron, 72, 404–416. doi:10.1016/j.neuron.2011.08.026
   PubMed Web of Science ®Google Scholar
• Haynes, J. D., & Rees, G. (2006). Decoding mental states from brain activity in humans. Nature Reviews Neuroscience, 7, 523–534. doi:10.1038/nrn1931
   PubMed Web of Science ®Google Scholar
• Holland, J. H., Holyoak, K. J., Nisbett, R. E., Thagard, P. R., & Smoliar, S. W. (1987). Induction: Processes of inference, learning, and discovery. IEEE Expert, 2(3), 92–93.
   Google Scholar
• Hsieh, L. T., Gruber, M. J., Jenkins, L. J., & Ranganath, C. (2014). Hippocampal activity patterns carry information about objects in temporal context. Neuron, 81, 1165–1178. doi:10.1016/j.neuron.2014.01.015
   PubMed Web of Science ®Google Scholar
• Hubel, D. H., & Wiesel, T. N. (1970). The period of susceptibility to the physiological effects of unilateral eye closure in kittens. The Journal of Physiology, 206, 419–436.
   PubMed Web of Science ®Google Scholar
• Huth, A. G., Nishimoto, S., Vu, A. T., & Gallant, J. L. (2012). A continuous semantic space describes the representation of thousands of object and action categories across the human brain. Neuron, 76, 1210–1224. doi:10.1016/j.neuron.2012.10.014
   PubMed Web of Science ®Google Scholar
• Kamitani, Y., & Tong, F. (2005). Decoding the visual and subjective contents of the human brain. Nature Neuroscience, 8(5), 679–685. doi:10.1038/nn1444
   PubMed Web of Science ®Google Scholar
• Kanwisher, N., McDermott, J., & Chun, M. M. (1997). The fusiform face area: A module in human extrastriate cortex specialized for face perception. Journal of Neuroscience, 17, 4302–4311.
   PubMed Web of Science ®Google Scholar
• Kay, K. N., Naselaris, T., Prenger, R. J., & Gallant, J. L. (2008). Identifying natural images from human brain activity. Nature, 452, 352–355. doi:10.1038/nature06713
   PubMed Web of Science ®Google Scholar
• Khaligh-Razavi, S. M., & Kriegeskorte, N. (2014). Deep supervised, but not unsupervised, models may explain IT cortical representation. PLoS Computational Biology, 10:e10003915. doi:10.1371/journal.pcbi.1003915
   Google Scholar
• Kriegeskorte, N. (2009). Relating population-code representations between man, monkey, and computational models. Frontiers in Neuroscience, 3, 363–373. doi:10.3389/neuro.01.035.2009
   PubMedGoogle Scholar
• Kriegeskorte, N. (2011). Pattern-information analysis: From stimulus decoding to computational-model testing. Neuroimage, 56, 411–421. doi:10.1016/j.neuroimage.2011.01.061
   PubMed Web of Science ®Google Scholar
• Kriegeskorte, N., & Bandettini, P. A. (2007). Analyzing for information, not activation, to exploit high-resolution fMRI. NeuroImage, 38, 649–662. doi:10.1016/j.neuroimage.2007.02.022
   PubMed Web of Science ®Google Scholar
• Kriegeskorte, N., Formisano, E., Sorger, B., & Goebel, R. (2007). Individual faces elicit distinct response patterns in human anterior temporal cortex. PNAS, 104, 20600–20605. doi:10.1073/pnas.0705654104
   PubMed Web of Science ®Google Scholar
• Kriegeskorte, N., Goebel, R., & Bandettini, P. A. (2006). Information-based functional brain mapping. PNAS, 103, 3863–3868. doi:10.1073/pnas.0600244103
   PubMed Web of Science ®Google Scholar
• Kriegeskorte, N., & Kievit, R. A. (2013). Representational geometry: Integrating cognition, computation, and the brain. Trends in Cognitive Sciences, 17, 401–412. doi:10.1016/j.tics.2013.06.007
   PubMed Web of Science ®Google Scholar
• Kriegeskorte, N., & Kreiman, G. (2012). Visual population codes: Toward a common multivariate framework for cell recording and functional imaging. Cambridge, MA: The MIT Press.
   Google Scholar
• Kriegeskorte, N., & Mur, M. (2012). Inverse MDS: Inferring dissimilarity structure from multiple item arrangements. Frontiers in Psychology, 3. doi:10.3389/fpsyg.2012.00245
   Google Scholar
• Kriegeskorte, N., Mur, M., & Bandettini, P. A. (2008). Representational similarity analysis – Connecting the branches of systems neuroscience. Frontiers in Systems Neuroscience. doi:10.3389/neuro.06.004.2008
   PubMedGoogle Scholar
• Kriegeskorte, N., Mur, M., Ruff, D. A., Kiani, R., Bodurka, J., Esteky, H., … Bandettini, P. A. (2008). Matching categorical object representations in inferior temporal cortex of man and monkey. Neuron, 60, 1126–1141. doi:10.1016/j.neuron.2008.10.043
   PubMed Web of Science ®Google Scholar
• Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2012, December). Imagenet classification with deep convolutional neural networks (pp. 1097–1105). Paper presented at the Advances in neural information processing systems, Lake Tahoe, NV.
   Google Scholar
• Le, Q. V., Ranzato, M. A., Monga, R., Devin, M., Chen, K., Corrado, G., … Ng, A. (2012, June-July). Building high-level features using large scale unsupervised learning. Presented at the Proceedings of the 29th International Conference on Machine Learning (ICML-12), (pp. 81–88), Edinburgh: IEEE.
   Google Scholar
• Leeds, D. D., Seibert, D. A., Pyles, J. A., & Tarr, M. J. (2013). Comparing visual representations across human fMRI and computational vision. Journal of Vision, 13, 25–25. doi:10.1167/13.13.25
   PubMed Web of Science ®Google Scholar
• Marr, D. (1982). Vision: A computational approach. New-York, NJ: Freeman.
   Google Scholar
• Marr, D. (2010). Vision: A computational investigation into the human representation and processing of visual information. Cambridge, MA: MIT Press.
   Google Scholar
• Martens, S., Kandula, M., & Duncan, J. (2010). Restricted attentional capacity within but not between sensory modalities: An individual differences approach. PLoS One, 5, e15280. doi:10.1371/journal.pone.0015280
   Google Scholar
• Miller, G. A. (1995). WordNet: A lexical database for English. Communications of the ACM, 38(11), 39–41. doi:10.1145/219717.219748
   Web of Science ®Google Scholar
• Miller, M. B., Donovan, C. L., Bennett, C. M., Aminoff, E. M., & Mayer, R. E. (2012). Individual differences in cognitive style and strategy predict similarities in the patterns of brain activity between individuals. NeuroImage, 59(1), 83–93. doi:10.1016/j.neuroimage.2011.05.060
   PubMed Web of Science ®Google Scholar
• Mitchell, T. M., Shinkareva, S. V., Carlson, A., Chang, K. M., Malave, V. L., Mason, R. A., & Just, M. A. (2008). Predicting human brain activity associated with the meanings of nouns. Science, 320, 1191–1195. doi:10.1126/science.1152876
   PubMed Web of Science ®Google Scholar
• Mur, M., Meys, M., Bodurka, J., Goebel, R., Bandettini, P. A., & Kriegeskorte, N. (2013). Human object-similarity judgments reflect and transcend the primate-it object representation. Frontiers in Psychology, 4, 128. doi:10.3389/fpsyg.2013.00128
   Google Scholar
• Mur, M., Ruff, D. A., Bodurka, J., De Weerd, P., Bandettini, P. A., & Kriegeskorte, N. (2012). Categorical, yet graded - Single-image activation profiles of human category-selective cortical regions. Journal of Neuroscience, 32, 8649–8662. doi:10.1523/JNEUROSCI.2334-11.2012
   PubMed Web of Science ®Google Scholar
• Norman, K. A., Polyn, S. M., Detre, G. J., & Haxby, J. V. (2006). Beyond mind-reading: Multi-voxel pattern analysis of fMRI data. Trends in Cognitive Sciences, 10, 424–430. doi:10.1016/j.tics.2006.07.005
   PubMed Web of Science ®Google Scholar
• Ochsner, K. N., Bunge, S. A., Gross, J. J., & Gabrieli, J. D. E. (2002). Rethinking feelings: An fMRI Study of the cognitive regulation of emotion. Journal of Cognitive Neuroscience, 14, 1215–1229. doi:10.1162/089892902760807212
   PubMed Web of Science ®Google Scholar
• O’Toole, A. J., Jiang, F., Abdi, H., & Haxby, J. V. (2005). Partially distributed representations of objects and faces in ventral temporal cortex. Journal of Cognitive Neuroscience, 17, 580–590. doi:10.1162/0898929053467550
   PubMed Web of Science ®Google Scholar
• Parasuraman, R., & Jiang, Y. (2012). Individual differences in cognition, affect, and performance: Behavioral, neuroimaging, and molecular genetic approaches. NeuroImage, 59(1), 70–82. doi:10.1016/j.neuroimage.2011.04.040
   PubMed Web of Science ®Google Scholar
• Pascual-Leone, A., Amedi, A., Fregni, F., & Merabet, L. B. (2005). The plastic human brain cortex. Annual Review of Neuroscience, 28, 377–401. doi:10.1146/annurev.neuro.27.070203.144216
   PubMed Web of Science ®Google Scholar
• Pascual-Leone, A., Freitas, C., Oberman, L., Horvath, J. C., Halko, M., Eldaief, M., … Rotenberg, A. (2011). Characterizing brain cortical plasticity and network dynamics across the age-span in health and disease with TMS-EEG and TMS-fMRI. Brain Topography, 24, 302–315. doi:10.1007/s10548-011-0196-8
   PubMed Web of Science ®Google Scholar
• Popivanov, I. D., Jastorff, J., Vanduffel, W., & Vogels, R. (2013). Heterogeneous single-unit selectivity in an fMRI-defined body-selective patch. Journal of Neuroscience, 34(1), 95–111. doi:10.1523/JNEUROSCI.2748-13.2014
   Web of Science ®Google Scholar
• Raizada, R. D. S., & Connolly, A. C. (2012). What makes different people's representations alike: Neural similarity space solves the problem of across-subject fMRI decoding. Journal of Cognitive Neuroscience, 24, 868–877. doi:10.1162/jocn_a_00189
   PubMed Web of Science ®Google Scholar
• Raizada, R. D. S., Tsao, F. M., Liu, H. M., Holloway, I. D., Ansari, D., & Kuhl, P. K. (2010). Linking brain-wide multivoxel activation patterns to behaviour: Examples from language and math. NeuroImage, 51, 462–471. doi:10.1016/j.neuroimage.2010.01.080
   PubMed Web of Science ®Google Scholar
• Raizada, R. D. S., Tsao, F. M., Liu, H. M., & Kuhl, P. K. (2010). Quantifying the adequacy of neural representations for a cross-language phonetic discrimination task: Prediction of individual differences. Cerebral Cortex, 20(1), 1–12. doi:10.1093/cercor/bhp076
   PubMed Web of Science ®Google Scholar
• Riesenhuber, M., & Poggio, T. (1999). Hierarchical models of object recognition in cortex. Nature Neuroscience, 2, 1019–1025. doi:10.1038/14819
   PubMed Web of Science ®Google Scholar
• Rogers, T. T., Hocking, J., Noppeney, U., Mechelli, A., Gorno-Tempini, M. L., Patterson, K., & Price, C. J. (2006). Anterior temporal cortex and semantic memory: Reconciling findings from neuropsychology and functional imaging. Cognitive, Affective & Behavioral Neuroscience, 6, 201–213. doi:10.3758/CABN.6.3.201
   PubMed Web of Science ®Google Scholar
• Saygin, Z. M., Osher, D. E., Koldewyn, K., Reynolds, G., Gabrieli, J. D. E., & Saxe, R. R. (2011). Anatomical connectivity patterns predict face selectivity in the fusiform gyrus. Nature Neuroscience, 15, 321–327. doi:10.1038/nn.3001
   PubMed Web of Science ®Google Scholar
• Schwarzkopf, D. S., & Rees, G. (2013). Subjective size perception depends on central visual cortical magnification in human V1. PLoS One, 8, e60550. doi:10.1371/journal.pone.0060550
   Google Scholar
• Schwarzkopf, D. S., Song, C., & Rees, G. (2010). The surface area of human V1 predicts the subjective experience of object size. Nature Neuroscience, 14(1), 28–30. doi:10.1038/nn.2706
   PubMed Web of Science ®Google Scholar
• Serre, T., Oliva, A., & Poggio, T. (2007). A feedforward architecture accounts for rapid categorization. Proceedings of the National Academy of Sciences of the United States of America, 104, 6424–6429. doi:10.1073/pnas.0700622104
   PubMed Web of Science ®Google Scholar
• Shinkareva, S. V., Malave, V. L., Just, M. A., & Mitchell, T. M. (2012). Exploring commonalities across participants in the neural representation of objects. Human Brain Mapping, 33, 1375–1383. doi:10.1002/hbm.21296
   PubMed Web of Science ®Google Scholar
• Simmons, D. R., Robertson, A. E., McKay, L. S., Toal, E., McAleer, P., & Pollick, F. E. (2009). Vision in autism spectrum disorders. Vision Research, 49, 2705–2739. doi:10.1016/j.visres.2009.08.005
   PubMed Web of Science ®Google Scholar
• Spiridon, M., & Kanwisher, N. (2002). How distributed is visual category information in human occipito-temporal cortex? An fMRI study. Neuron, 35, 1157–1165. doi:10.1016/S0896-6273(02)00877-2
   PubMed Web of Science ®Google Scholar
• Troiani, V., Stigliani, A., Smith, M. E., & Epstein, R. A. (2012). Multiple object properties drive scene-selective regions. Cerebral Cortex. doi:10.1093/cercor/bhs364
   PubMed Web of Science ®Google Scholar
• Tyler, L. K., Stamatakis, E. A., Bright, P., Acres, K., Abdallah, S., Rodd, J. M., & Moss, H. E. (2004). Processing objects at different levels of specificity. Journal of Cognitive Neuroscience, 16, 351–362.
   PubMed Web of Science ®Google Scholar
• Ungerleider, L. G., & Haxby, J. V. (1994). “What” and “Where” in the human brain. Current Opinion in Neurobiology, 4, 157–165. doi:10.1016/0959-4388(94)90066-3
   PubMedGoogle Scholar
• Weiner, K. S., & Grill-Spector, K. (2010). Sparsely-distributed organization of face and limb activations in human ventral temporal cortex. NeuroImage, 52, 1559–1573. doi:10.1016/j.neuroimage.2010.04.262
   PubMed Web of Science ®Google Scholar
• Weiner, K. S., & Grill-Spector, K. (2011). Neural representations of faces and limbs neighbor in human high-level visual cortex: Evidence for a new organization principle. Psychological Research, 77(1), 74–97. doi:10.1007/s00426-011-0392-x
   PubMed Web of Science ®Google Scholar
• Worsley, K. J., Evans, A. C., Marrett, S., & Neelin, P. (1992). A three-dimensional statistical analysis for CBF activation studies in human brain. Journal of Cerebral Blood Flow and Metabolism: Official Journal of the International Society of Cerebral Blood Flow and Metabolism, 12, 900–918. doi:10.1038/jcbfm.1992.127
   PubMed Web of Science ®Google Scholar
• Zeiler, M. D., & Fergus, R. (2013). Visualizing and understanding convolutional neural networks. CoRR, abs/1311.2901.
   Google Scholar