967
Views
21
CrossRef citations to date
0
Altmetric
Articles

The psychometric properties of the “Reading the Mind in the Eyes” Test: an item response theory (IRT) analysis

, &
Pages 233-253 | Received 07 Oct 2016, Accepted 21 Feb 2017, Published online: 13 Mar 2017

References

  • Abu-Akel, A., & Shamay-Tsoory, S. (2011). Neuroanatomical and neurochemical bases of theory of mind. Neuropsychologia, 49, 2971–2984. doi: 10.1016/j.neuropsychologia.2011.07.012
  • Ahmed, F. S., & Stephen Miller, L. (2011). Executive function mechanisms of theory of mind. Journal of Autism & Developmental Disorders, 41, 667–678. doi: 10.1007/s10803-010-1087-7
  • Akaike, H. (1987). Factor Analysis and AIC. Psychometrika, 52, 317–332. doi: 10.1007/BF02294359
  • Allman, J. M., Hakeem, A., Erwin, J. M., Nimchinsky, E., & Hof, P. (2001). The anterior cingulate cortex. The evolution of an interface between emotion and cognition. Annals of the New York Academy of Sciences, 935, 107–117. doi: 10.1111/j.1749-6632.2001.tb03476.x
  • Baker, F., & Kim, S. H. (2004). Item response theory (2nd ed.). New York, NY: Marcel Dekker.
  • Balogh, N., Egerházi, A., Berecz, R., & Csukly, G. (2014). Investigating the state-like and trait-like characters of social cognition in schizophrenia: A short term follow-up study. Schizophrenia Research, 159, 499–505. doi: 10.1016/j.schres.2014.08.027
  • Baron-Cohen, S. (1995). Mindblindness: An essay on autism and theory of mind. Cambridge, MA: MIT Press.
  • Baron-Cohen, S. (2010). Empathizing, systemizing, and the extreme male brain theory of autism. Progress in Brain Research, 186, 167–175. doi: 10.1016/B978-0-444-53630-3.00011-7
  • Baron-Cohen, S., Bowen, D. C., Holt, R. J., Allison, C., Auyeung, B., Lombardo, M. V., … Lai, M. C. (2015). The “reading the mind in the eyes” test: Complete absence of typical sex difference in 400 men and women with autism. PLoS One, 10(8), e0136521. doi: 10.1371/journal.pone.0136521
  • Baron-Cohen, S., Jolliffe, T., Mortimore, C., & Robertson, M. (1997). Another advanced test of theory of mind: Evidence from very high functioning adults with autism or Asperger syndrome. Journal of Child Psychology & Psychiatry, 38(7), 813–822. doi: 10.1111/j.1469-7610.1997.tb01599.x
  • Baron-Cohen, S., Wheelwright, S., Hill, J., Raste, Y., & Plumb, I. (2001). The “reading the mind in the eyes” test revised version: A study with normal adults, and adults with Asperger syndrome or high-functioning autism. Journal of Child Psychology and Psychiatry, 42(2), 241–251. doi: 10.1111/1469-7610.00715
  • Bartolucci, F., Bacci, S., & Gnaldi, M. (2015). Statistical analysis of questionnaires: A unified approach based on R and Stata. Boca Raton, FL: CRC Press.
  • Batson, D. C. (2009). These things called empathy: Eight related but distinct phenomena. In J. Decety & W. Ickes (Eds.), The social neuroscience of empathy. Social neuroscience (pp. 3–15). Cambridge, MA: MIT Press.
  • Benaglia, T., Chauveau, D., Hunter, D. R., & Young, D. S. (2009). mixtools: An R package for analyzing finite mixture models. Journal of Statistical Software, 32, 1–29. Retrieved from http://www.jstatsoft.org/v32/i06/ doi: 10.18637/jss.v032.i06
  • Bernstein, I. H., & Teng, G. (1989). Factoring items and factoring scales are different: Spurious evidence for multidimensionality due to item categorization. Psychological Bulletin, 105, 467–477. doi: 10.1037/0033-2909.105.3.467
  • Birnbaum, A. (1968). Some latent trait models and their use in inferring an examinee’s ability. In F. Lord & M. Novick (Eds.), Statistical theories of mental test scores (pp. 397–479). Reading, MA: Addison-Wesley.
  • Bologna, M., Fabbrini, G., Marsili, L., Defazio, G., Thompson, P. D., & Berardelli, A. (2013). Facial bradykinesia. Journal of Neurology, Neurosurgery, and Psychiatry, 84, 681–685. doi: 10.1136/jnnp-2012-303993
  • Bond, T. G., & Fox, C. M. (2007). Applying the Rasch model: Fundamental measurement in the human sciences (2nd. ed.). Mahwah, NJ: Erlbaum.
  • Bonett, D. G. (2002). Sample size requirements for testing and estimating coefficient alpha. Journal of Educational and Behavioral Statistics, 27, 335–340. doi: 10.3102/10769986027004335
  • Bonini, L. (2016). The extended mirror neuron network: Anatomy, origin, and functions. Neuroscientist. 2016 Jan 8. pii: 1073858415626400.
  • Bora, E., & Köse, S. (2016). Meta-analysis of theory of mind in anorexia nervosa and bulimia nervosa: A specific mpairment of cognitive perspective taking in anorexia nervosa? International Journal of Eating Disorders, 49, 739–740. doi: 10.1002/eat.22572
  • Bora, E., Walterfang, M., & Velakoulis, D. (2015). Theory of mind in Parkinson’s disease: A meta-analysis. Behavioural Brain Research, 292, 515–520. doi: 10.1016/j.bbr.2015.07.012
  • Campbell, M. E., & Cunnington, R. (2017). More than an imitation game: Top-down modulation of the human mirror system. Neuroscience & Biobehavioral Reviews, 75, 195–202. doi: 10.1016/j.neubiorev.2017.01.035
  • Carey, J. M., & Cassels, T. G. (2013). Comparing two forms of a childhood perspective-taking measure using CFA and IRT. Psychological Assessment, 25(3), 879–892. doi: 10.1037/a0032641
  • Carré, J. M., Fisher, P. M., Manuck, S. B., & Hariri, A. R. (2012). Interaction between trait anxiety and trait anger predict amygdala reactivity to angry facial expressions in men but not women. Social Cognitive and Affective Neuroscience, 7, 213–221. doi: 10.1093/scan/nsq101
  • Crane, P. K., van Belle, G., & Larson, E. B. (2004). Test bias in a cognitive test: Differential item functioning in the CASI. Statistics in Medicine, 23(2), 241–256. doi: 10.1002/sim.1713
  • Davies, H., Wolz, I., Leppanen, J., Fernandez-Aranda, F., Schmidt, U., & Tchanturia, K. (2016). Facial expression to emotional stimuli in non-psychotic disorders: A systematic review and meta-analysis. Neuroscience & Biobehavioral Reviews, 64, 252–271. doi: 10.1016/j.neubiorev.2016.02.015
  • De Bruin, G. P. (2004). Problems with the factor analysis of items: Solutions based on item response theory and item parcelling. SA Journal of Industrial Psychology, 30(4), 16–26. doi: 10.4102/sajip.v30i4.172
  • di Pellegrino, G., Fadiga, L., Fogassi, L., Gallese, V., & Rizzolatti, G. (1992). Understanding motor events: A neurophysiological study. Experimental Brain Research, 91, 176–180. doi: 10.1007/BF00230027
  • Dorans, N. J., & Kulick, E. (1986). Demonstrating the utility of the standardization approach to assessing unexpected differential item performance on the scholastic aptitude test. Journal of Educational Measurement, 23, 355–368. doi: 10.1111/j.1745-3984.1986.tb00255.x
  • Drasgow, F., & Lissak, R. (1983). Modified parallel analysis: A procedure for examining the latent dimensionality of dichotomously scored item responses. Journal of Applied Psychology, 68, 363–373. doi: 10.1037/0021-9010.68.3.363
  • Duval, C., Piolino, P., Bejanin, A., Eustache, F., & Desgranges, B. (2011). Age effects on different components of theory of mind. Consciousness and Cognition, 20, 627–642. doi: 10.1016/j.concog.2010.10.025
  • Eddy, C. M., Cavanna, A. E., & Hansen, P. C. (2017). Empathy and aversion: The neural signature of mentalizing in Tourette syndrome. Psychological Medicine, 47, 507–517. doi: 10.1017/S0033291716002725
  • Eddy, C. M., Mitchell, I. J., Beck, S. R., Cavanna, A. E., & Rickards, H. (2011). Social reasoning in Tourette syndrome. Cognitive Neuropsychiatry, 16, 326–347. doi: 10.1080/13546805.2010.538213
  • Ernst, M., Nelson, E. E., Jazbec, S., McClure, E. B., Monk, C. S., Leibenluft, E., … Pine, D. S. (2005). Amygdala and nucleus accumbens in responses to receipt and omission of gains in adults and adolescents. Neuroimage, 25, 1279–1291. doi: 10.1016/j.neuroimage.2004.12.038
  • Feeser, M., Fan, Y., Weigand, A., Hahn, A., Gärtner, M., Böker, H., … Bajbouj, M. (2015). Oxytocin improves mentalizing pronounced effects for individuals with attenuated ability to empathize. Psychoneuroendocrinology, 53, 223–232. doi: 10.1016/j.psyneuen.2014.12.015
  • Ferguson, F. J., & Austin, E. J. (2010). Associations of trait and ability emotional intelligence with performance on theory of mind tasks in an adult sample. Personality and Individual Differences, 49, 414–418. doi: 10.1016/j.paid.2010.04.009
  • Floresco, S. B. (2015). The nucleus accumbens: An interface between cognition, emotion, and action. Annual Review of Psychology, 66, 25–52. doi: 10.1146/annurev-psych-010213-115159
  • Gadermann, A. M., Guhn, M., & Zumbo, B. D. (2012). Estimating ordinal reliability for Likert-type and ordinal item response data: A conceptual, empirical, and practical guide. Practical Assessment, Research & Evaluation, 17, 1–13. Retrieved from http://pareonline.net/pdf/v17n2.pdf
  • Gallese, V. (2003). The roots of empathy: The shared manifold hypothesis and the neural basis of intersubjectivity. Psychopathology, 36, 171–180. doi: 10.1159/000072786
  • Ganos, C., Ogrzal, T., Schnitzler, A., & Münchau, A. (2012). The pathophysiology of echopraxia/echolalia: Relevance to Gilles de la Tourette syndrome. Movement Disorders, 27, 1222–1229. doi: 10.1002/mds.25103
  • Geary, D. C. (2002). Sexual selection and sex differences in social cognition. In A. V. McGillicuddy-De Lisi & R. De Lisi (Eds.), Biology, society, and behavior: The development of sex differences in cognition (pp. 23–53). Greenwich, CT: Ablex/Greenwood.
  • Grove, R., Baillie, A., Allison, C., Baron-Cohen, S., & Hoekstra, R. A. (2014). The latent structure of cognitive and emotional empathy in individuals with autism, first-degree relatives and typical individuals. Molecular Autism, 5, 42. doi: 10.1186/2040-2392-5-42
  • Guastella, A. J., Einfeld, S. L., Gray, K. M., Rinehart, N. J., Tonge, B. J., Lambert, T. J., & Hickie, I. B. (2010). Intranasal oxytocin improves emotion recognition for youth with autism spectrum disorders. Biological Psychiatry, 67(7), 692–694. doi: 10.1016/j.biopsych.2009.09.020
  • Haber, S. N., Kunishio, K., Mizobuchi, M., & Lynd-Balta, E. (1995). The orbital and medial prefrontal circuit through the primate basal ganglia. Journal of Neuroscience, 15(7 Pt 1), 4851–4867.
  • Harkness, K. L., Jacobson, J. A., Duong, D., & Sabbagh, M. A. (2010). Mental state decoding in past major depression: Effect of sad versus happy mood induction. Cognition & Emotion, 24, 497–513. doi: 10.1080/02699930902750249
  • Harkness, K. L., Sabbagh, M. A., Jacobson, J. A., Chowdrey, N. K., & Chen, T. (2005). Enhanced accuracy of mental state decoding in dysphoric college students. Cognition & Emotion, 19, 999–1025. doi: 10.1080/02699930541000110
  • Hauk, O., & Pulvermüller, F. (2004). Neurophysiological distinction of action words in the fronto-central cortex. Human Brain Mapping, 21, 191–201. doi: 10.1002/hbm.10157
  • Holland, P. W., & Thayer, D. T. (1988). Differential item performance and the Mantel-Haenszel procedure. In H. Wainer & H. I. Braun (Dirs.), Test validity (pp. 129–145). Hillsdale, NJ: Lawrence Erlbaum Associates.
  • Iacoboni, M. (2009). Imitation, empathy, and mirror neurons. Annual Review of Psycholoy, 60, 653–670. doi: 10.1146/annurev.psych.60.110707.163604
  • Johnson, V. E. (2013). Revised standards for statistical evidence. Proceedings of the National Academy of Sciences of the United States of America, 110(48), 19313–19317. doi: 10.1073/pnas.1313476110
  • Khorashad, B. S., Baron-Cohen, S., Roshan, G. M., Kazemian, M., Khazai, L., Aghili, Z.,  Afkhamizadeh, M. (2015). The “Reading the Mind in the Eyes” Test: Investigation of Psychometric Properties and Test-Retest Reliability of the Persian Version. Journal of Autism and Developmental Disorders, 45, 2651–2666.
  • Kret, M. E., & De Gelder, B. (2012). A review on sex differences in processing emotional signals. Neuropsychologia, 50(7), 1211–1221. doi: 10.1016/j.neuropsychologia.2011.12.022
  • Lamm, C., & Majdandi, J. (2015). The role of shared neural activations, mirror neurons, and morality in empathya critical comment. Neuroscience Research, 90, 15–24. doi: 10.1016/j.neures.2014.10.008
  • Lipps, T. (1903). Einfühlung, innere Nachahmung und Organempfindung [German]. Archiv für die gesamte Psychologie, 1, 465–519.
  • Lord, F. (1980). Applications of item response theory to practical testing problems. Hillsdale, NJ: Lawrence Erlbaum Associates.
  • Magis, D., Beland, S., & Raiche, G. (2015). difR: Collection of methods to detect dichotomous differential item functioning (DIF). R package version 4.6. Retrieved from https://cran.r-project.org/web/packages/difR/difR.pdf
  • Mair, P., & Hatzinger, R. (2007). Extended Rasch modeling: The eRm package for the application of IRT models in R. Journal of Statistical Software, 20(9), 1–20. Retrieved from http://www.jstatsoft.org/v20/i09
  • Marsh, A. A. (2016). Understanding amygdala responsiveness to fearful expressions through the lens of psychopathy and altruism. Journal of Neuroscience Research, 94, 513–525. doi: 10.1002/jnr.23668
  • Mislevy, R. J. (1986). Bayes modal estimation in item response models. Psychometrika, 51, 177–195. doi: 10.1007/BF02293979
  • Monk, C. S., Klein, R. G., Telzer, E. H., Schroth, E. A., Mannuzza, S., Moulton, J. L., … Ernst, M. (2008). Amygdala and nucleus accumbens activation to emotional facial expressions in children and adolescents at risk for major depression. American Journal of Psychiatry, 165, 90–98. doi: 10.1176/appi.ajp.2007.06111917
  • Morizot, J., Ainsworth, A. T., & Reise, S. P. (2007). Toward modern psychometrics: Application of item response theory models in personality research. In R. W. Robins, R. C. Fraley, & R. F. Krueger (Eds.), Handbook of research methods in personality psychology (pp. 407–423). New York, NY: Guilford.
  • Nunnally, J. C., & Bernstein, I. H. (1994). Psychometric theory (3rd ed.). New York, NY: McGraw-Hill.
  • Olderbak, S., Wilhelm, O., Olaru, G., Geiger, M., Brenneman, M. W., & Roberts, R. D. (2015). A psychometric analysis of the reading the mind in the eyes test: Toward a brief form for research and applied settings. Frontiers in Psychology, 6, 1503.
  • Oldershaw, A., Lavender, T., Sallis, H., Stahl, D., & Schmidt, U. (2015). Emotion generation and regulation in anorexia nervosa: A systematic review and meta-analysis of self-report data. Clinical Psychology Review, 39, 83–95. doi: 10.1016/j.cpr.2015.04.005
  • Orsmond, G. I., Shattuck, P. T., Cooper, B. P., Sterzing, P. R., & Anderson, K. A. (2013). Social participation among young adults with an autism spectrum disorder. Journal of Autism and Developmental Disorders, 43, 2710–2719. doi: 10.1007/s10803-013-1833-8
  • Ponocny, I. (2001). Nonparametric goodness-of-fit tests for the Rasch model. Psychometrika, 66, 437–459. doi: 10.1007/BF02294444
  • Preston, S. D., & de Waal, F. B. (2002). Empathy: Its ultimate and proximate bases. Behavioral and Brain Sciences, 25, 1–20. discussion 20–71.
  • Prevost, M., Carrier, M. E., Chowne, G., Zelkowitz, P., Joseph, L., & Gold, I. (2014). The reading the mind in the eyes test: Validation of a French version and exploration of cultural variations in a multi-ethnic city. Cognitive Neuropsychiatry, 19, 189–204. doi: 10.1080/13546805.2013.823859
  • Pridmore, S., Brüne, M., Ahmadi, J., & Dale, J. (2008). Echopraxia in schizophrenia: possible mechanisms. Australian and New Zealand Journal of Psychiatry, 42, 565–571. doi: 10.1080/00048670802119747
  • Prinz, W. (1997). Perception and action planning. European Journal of Cognitive Psychology, 9, 129–154. doi: 10.1080/713752551
  • R Core Team. (2015). R: A language and environment for statistical computing. Vienna: R Foundation for Statistical Computing.
  • Radke, S., & de Bruijn, E. R. (2015). Does oxytocin affect mind-reading? A replication study. Psychoneuroendocrinology, 60, 75–81. doi: 10.1016/j.psyneuen.2015.06.006
  • Raju, N. S. (1990). Determining the significance of estimated signed and unsigned areas between two item response functions. Applied Psychological Measurement, 14, 197–207. doi: 10.1177/014662169001400208
  • Rasch, G. (1960). Probabilistic models for some intelligence and attainment tests. Copenhagen: Paedagogike Institut.
  • Rizopoulos, D. (2006). ltm: An R package for latent variable modelling and item response theory analyses. Journal of Statistical Software, 17, 1–25. doi: 10.18637/jss.v017.i05
  • Rizzolatti, G., & Fogassi, L. (2014). The mirror mechanism: Recent findings and perspectives. Philosophical transactions of the Royal Society of London. Philosophical Transactions of the Royal Society B: Biological Sciences, 369(1644), 20130420. doi: 10.1098/rstb.2013.0420
  • Rutherford, H. J., Wareham, J. D., Vrouva, I., Mayes, L. C., Fonagy, P., & Potenza, M. N. (2012). Sex differences moderate the relationship between adolescent language and mentalization. Personality Disorders, 3(4), 393–405. doi: 10.1037/a0028938
  • Schiffer, B., Pawliczek, C., Muller, B. W., Gizewski, E. R., & Walter, H. (2013). Why don’t men understand women? Altered neural networks for reading the language of male and female eyes. PLoS One, 8(4), e60278. doi: 10.1371/journal.pone.0060278
  • Schwarz, G. (1978). Estimating the dimension of a model. The Annals of Statistics, 6, 461–464. doi: 10.1214/aos/1176344136
  • Sebastian, C. L., Fontaine, N. M., Bird, G., Blakemore, S. J., Brito, S. A., McCrory, E. J., & Viding, E. (2012). Neural processing associated with cognitive and affective theory of mind in adolescents and adults. Social Cognitive and Affective Neuroscience, 7, 53–63. doi: 10.1093/scan/nsr023
  • Shur, S., Shamay-Tsoory, S. G., & Levkovitz, Y. (2008). Integration of emotional and cognitive aspects of theory of mind in schizophrenia and its relation to prefrontal neurocognitive performance. Cognitive Neuropsychiatry, 13, 472–490. doi: 10.1080/13546800802490034
  • Sowden, S., Koehne, S., Catmur, C., Dziobek, I., & Bird, G. (2016). Intact automatic imitation and typical spatial compatibility in autism spectrum disorder: Challenging the broken mirror theory. Autism Research, 9, 292–300. doi: 10.1002/aur.1511
  • Spengler, S., Bird, G., & Brass, M. (2010). Hyperimitation of actions is related to reduced understanding of others’ minds in autism spectrum conditions. Biological Psychiatry, 68, 1148–1155. doi: 10.1016/j.biopsych.2010.09.017
  • Spreng, R. N., McKinnon, M. C., Mar, R. A., & Levine, B. (2009). The Toronto empathy questionnaire: Scale development and initial validation of a factor-analytic solution to multiple empathy measures. Journal of Personality Assessment, 91(1), 62–71. doi: 10.1080/00223890802484381
  • Suslow, T., Kugel, H., Ohrmann, P., Stuhrmann, A., Grotegerd, D., Redlich, R.,  Dannlowski, U. (2013). Neural correlates of affective priming effects based on masked facial emotion: An fMRI study. Psychiatry Research, 211, 239–245. doi: 10.1016/j.pscychresns.2012.09.008
  • Swaminathan, H., & Gifford, J. A. (1986). Bayesian estimation in the three-parameter logistic model. Psychometrika, 51, 589–601. doi: 10.1007/BF02295598
  • Swaminathan, H., & Rogers, H. J. (1990). Detecting differential item functioning using logistic regression procedures. Journal of Educational Measurement, 27, 361–370. doi: 10.1111/j.1745-3984.1990.tb00754.x
  • Thompson, A. E., & Voyer, D. (2014). Sex differences in the ability to recognise non-verbal displays of emotion: a meta-analysis. Cognition and Emotion, 28(7), 1164–1195. doi: 10.1080/02699931.2013.875889
  • Torralva, T., Roca, M., Gleichgerrcht, E., Bekinschtein, T., & Manes, F. (2009). A neuropsychological battery to detect specific executive and social cognitive impairments in early frontotemporal dementia. Brain, 132, 1299–1309. doi: 10.1093/brain/awp041
  • Ungvari, G. S., Goggins, W., Leung, S. K., Lee, E., & Gerevich, J. (2009). Schizophrenia with prominent catatonic features (catatonic schizophrenia’) III. Latent class analysis of the catatonic syndrome. Progress in Neuro-Psychopharmacology & Biological Psychiatry, 33, 81–85. doi: 10.1016/j.pnpbp.2008.10.010
  • Vellante, M., Baron-Cohen, S., Melis, M., Marrone, M., Petretto, D. R., Masala, C., & Preti, A. (2013). The “reading the mind in the eyes” test: Systematic review of psychometric properties and a validation study in Italy. Cognitive Neuropsychiatry, 18(4), 326–354. doi: 10.1080/13546805.2012.721728
  • Voracek, M., & Dressler, S. G. (2006). Lack of correlation between digit ratio (2D:4D) and Baron-Cohen’s “Reading the Mind in the Eyes” test, empathy, systemising, and autism-spectrum quotients in a general population sample. Personality and Individual Differences, 41, 1481–1491. doi: 10.1016/j.paid.2006.06.009
  • Waller, N. G., Tellegen, A., McDonald, R. P., & Lykken, D. (1996). Exploring non-linear models in personality assessment: Development and preliminary validation of a negative emotionality scale. Journal of Personality, 64, 545–576. doi: 10.1111/j.1467-6494.1996.tb00521.x

Reprints and Corporate Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

To request a reprint or corporate permissions for this article, please click on the relevant link below:

Academic Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

Obtain permissions instantly via Rightslink by clicking on the button below:

If you are unable to obtain permissions via Rightslink, please complete and submit this Permissions form. For more information, please visit our Permissions help page.