Decoding task and stimulus representations in face-responsive cortex

ABSTRACT

Observers can deliberately attend to some aspects of a face (e.g. emotional expression) while ignoring others. How do internal goals influence representational geometry in face-responsive cortex? Participants watched videos of naturalistic dynamic faces during MRI scanning. We measured multivariate neural response patterns while participants formed an intention to attend to a facial aspect (age, or emotional valence), and then attended to that aspect, and responses to the face's emotional valence, independent of attention. Distinct patterns of response to the two tasks were found while forming the intention, in left fronto-lateral but not face-responsive regions, and while attending to the face, in almost all face-responsive regions. Emotional valence was represented in right posterior superior temporal sulcus and medial prefrontal cortex, but could not be decoded when unattended. Shifting the focus of attention thus alters cortical representation of social information, probably reflecting neural flexibility to optimally integrate goals and perceptual input.

KEYWORDS:

• Functional magnetic resonance imaging
• faces
• emotion
• social cognition
• split-half multivoxel pattern analyses

Acknowledgements

We thank Grace Lisandrelli and Benjamin Deen for their support with data acquisition, and Amy Skerry for sharing the stimuli.

Disclosure statement

No potential conflict of interest was reported by the authors.

Additional information

Funding

D.K. has been funded by a Feodor-Lynen Postdoctoral Fellowship of the Alexander von Humboldt-Stiftung. Stefano Anzellotti has been funded by a Fellowship from the Simons Foundation for the Social Brain. This work was supported by National Institutes of Health [grant number R01 MH096914].