Differences between multimedia and text-based assessments of emotion management: An exploration with the multimedia emotion management assessment (MEMA)

References

• Allen, V. D., Rahman, N., Weissman, A., MacCann, C., & Roberts, R. D. (2015). The situational test of emotional management—brief (STEM-B): Development and validation using item response theory and latent class analysis. Personality and Individual Differences, 81, 195–200. doi:10.1016/j.paid.2015.01.053
   Web of Science ®Google Scholar
• Allen, V. D., Weissman, A., Hellwig, S., MacCann, C., & Roberts, R. D. (2014). Development of the situational test of emotional understanding—brief (STEU-B) using item response theory. Personality and Individual Differences, 65, 3–7. doi:10.1016/j.paid.2014.01.051
   Web of Science ®Google Scholar
• Bänziger, T., Grandjean, D., & Scherer, K. R. (2009). Emotion recognition from expressions in face, voice, and body: The multimodal emotion recognition test (MERT). Emotion, 9, 691–704. doi:10.1037/a0017088
   PubMed Web of Science ®Google Scholar
• Bänziger, T., Mortillaro, M., & Scherer, K. R. (2012). Introducing the Geneva multimodal expression corpus for experimental research on emotion perception. Emotion, 12, 1161–1179. doi:10.1037/a0025827
   PubMed Web of Science ®Google Scholar
• Bänziger, T., & Scherer, K. (2005). The role of intonation in emotional expressions. Speech Communication, 46, 252–267. doi:10.1016/j.specom.2005.02.016
   Web of Science ®Google Scholar
• Burrus, J., Betnacourt, A., Holtzman, S., Minsky, J., MacCann, C., & Roberts, R. D. (2012). Emotional intelligence relates to well-being: Evidence from the situational judgment test of emotional management. Applied Psychology: Health and Well-Being, 4, 151–166.
   PubMed Web of Science ®Google Scholar
• Callinan, M., & Robertson, I. T. (2000). Work sample testing. International Journal of Selection and Assessment, 8, 248–260. doi:10.1111/1468-2389.00154
   Web of Science ®Google Scholar
• Christian, M. S., Edwards, B. D., & Bradley, J. C. (2010). Situational judgment tests: Constructs assessed and a meta-analysis of their criterion-related validities. Personnel Psychology, 63, 83–117. doi:10.1111/j.1744-6570.2009.01163.x
   Web of Science ®Google Scholar
• Ciarrochi, J., Chan, A. Y. C., & Caputi, P. (2000). A critical evaluation of the emotional intelligence construct. Personality and Individual Differences, 28, 539–561. doi:10.1016/S0191-8869(99)00119-1
   Web of Science ®Google Scholar
• Côté, S. (2010). Taking the “intelligence” in emotional intelligence seriously. Industrial and Organizational Psychology: Perspectives on Science and Practice, 3, 127–130. doi:10.1111/j.1754-9434.2010.01211.x
   Web of Science ®Google Scholar
• Durlak, J. A., Weissberg, R. P., Dymnicki, A. B., Taylor, R. D., & Schellinger, K. B. (2011). The impact of enhancing students’ social and emotional learning: A meta-analysis of school-based universal interventions. Child Development, 82, 405–432. doi:10.1111/j.1467-8624.2010.01564.x
   PubMed Web of Science ®Google Scholar
• Ekstrom, R. B., French, J. W., Harman, H. H., & Derman, D. (1976). Manual for kit of factor-referenced cognitive tests. Princeton, NJ: Educational Testing Service.
   Google Scholar
• Fan, H., Jackson, T., Yang, X., Tang, W., & Shang, J. (2010). The factor structure of the Mayer-Salovey-Caruso emotional intelligence test V2.0: A meta-analytic structural equation modeling approach. Personality and Individual Differences, 48, 781–785. doi:10.1016/j.paid.2010.02.004
   Web of Science ®Google Scholar
• Freudenthaler, H. H., & Neubauer, A. C. (2005). Emotional intelligence: The convergent and discriminant validities of intra- and interpersonal emotional abilities. Personality and Individual Differences, 39, 569–579. doi:10.1016/j.paid.2005.02.004
   Web of Science ®Google Scholar
• Goldberg, L. R. (1999). A broad-bandwidth, public domain, personality inventory measuring the lower-level facets of several five-factor models. In I. Mervielde, I. Deary, F. De Fruyt, & F. Ostendorf (Eds.), Personality psychology in Europe (pp. 7–28). Tilburg: Tilburg University Press.
   Google Scholar
• Huebner, E. S. (1991). Initial development of the student's life satisfaction scale. School Psychology International, 12, 231–240. doi:10.1177/0143034391123010
   Google Scholar
• Joseph, D. L., & Newman, D. A. (2010). Emotional intelligence: An integrative meta-analysis and cascading model. Journal of Applied Psychology, 95, 54–78. doi:10.1037/a0017286
   PubMed Web of Science ®Google Scholar
• Kuncel, N., Crede, M., & Thomas, L. L. (2005). The validity of self-reported grade point averages, class ranks, and test scores: A meta-analysis and review of the literature. Review of Educational Research, 75, 63–82. doi:10.3102/00346543075001063
   Web of Science ®Google Scholar
• Legree, P. J., Pstoka, J., Robbins, J., Roberts, R. D., & Putka, D. J. (2014). Profile similarity metrics as an alternate framework to score rating-based tests: MSCEIT reanalyses. Intelligence, 47, 159–174. doi:10.1016/j.intell.2014.09.005
   Web of Science ®Google Scholar
• Libbrecht, N., & Lievens, F. (2012). Validity evidence for the situational judgment test paradigm in emotional intelligence measurement. International Journal of Psychology, 47, 438–447. doi:10.1080/00207594.2012.682063
   PubMed Web of Science ®Google Scholar
• Libbrecht, N., Lievens, F., Carette, B., & Côté, S. C. (2014). Emotional intelligence predicts success in medical school. Emotion, 14, 64–73. doi:10.1037/a0034392
   PubMed Web of Science ®Google Scholar
• Lievens, F., & Sackett, P. R. (2006). Video-based versus written situational judgment tests: A comparison in terms of predictive validity. Journal of Applied Psychology, 91, 1181–1188. doi:10.1037/0021-9010.91.5.1181
   PubMed Web of Science ®Google Scholar
• Lievens, F., Buyse, T., & Sackett, P. R. (2005). The operational validity of a video-based situational judgment test for medical college admissions: Illustrating the importance of matching predictor and criterion construct domains. Journal of Applied Psychology, 90, 442–452. doi:10.1037/0021-9010.90.3.442
   PubMed Web of Science ®Google Scholar
• Lopes, P. N., Brackett, M. A., Nezlek, J. B., Schütz, A., Sellin, I., & Salovey, P. (2004). Emotional intelligence and social interaction. Personality and Social Psychology Bulletin, 30, 1018–1034. doi:10.1177/0146167204264762
   PubMed Web of Science ®Google Scholar
• Lubinski, D. (2004). Introduction to the special section on cognitive abilities: 100 years after Spearman's (1904) “‘General intelligence’, objectively determined and measured”. Journal of Personality and Social Psychology, 86, 96–111. doi:10.1037/0022-3514.86.1.96
   PubMed Web of Science ®Google Scholar
• MacCann, C. (2010). Further examination of emotional intelligence as a standard intelligence: A latent variable analysis of fluid intelligence, crystallized intelligence, and emotional intelligence. Personality and Individual Differences, 49, 490–496. doi:10.1016/j.paid.2010.05.010
   Web of Science ®Google Scholar
• MacCann, C., & Roberts, R. D. (2008). New paradigms for assessing emotional intelligence: Theory and data. Emotion, 8, 540–551. doi:10.1037/a0012746
   PubMed Web of Science ®Google Scholar
• MacCann, C., Fogarty, G. J., Zeidner, M., & Roberts, R. D. (2011). Coping mediates the relationship between emotional intelligence (EI) and academic achievement. Contemporary Educational Psychology, 36, 60–70. doi:10.1016/j.cedpsych.2010.11.002
   Web of Science ®Google Scholar
• MacCann, C., Joseph, D. L., Newman, D. A., & Roberts, R. D. (2014). Emotional intelligence is a second-stratum factor of intelligence: Evidence from hierarchical and bifactor models. Emotion, 14, 358–374. doi:10.1037/a0034755
   PubMed Web of Science ®Google Scholar
• MacCann, C., Lipnevich, A. A., Burrus, J. B., & Roberts, R. D. (2012). The best years of our lives? Coping with stress predicts school grades, life satisfaction, and feelings about high school. Learning and Individual Differences, 22, 235–241. doi:10.1016/j.lindif.2011.08.004
   Web of Science ®Google Scholar
• MacCann, C., Pearce, N., & Roberts, R. D. (2011). Emotional intelligence as assessed by situational judgment and emotion recognition tests: Building the nomological net. Psychological Topics, 20, 393–412.
   Google Scholar
• Matsumoto, D., LeRoux, J., Wilson-Cohn, C., Raroque, J., Kooken, K., Ekman, P., … Goh, A. (2000). A new test to measure emotion recognition ability: Matsumoto and Ekman's Japanese and Caucasian Brief Affect Recognition Test (JACBART). Journal of Nonverbal Behaviour, 24, 179–209. doi:10.1023/A:1006668120583
   Web of Science ®Google Scholar
• Maul, A. (2012). The validity of the Mayer-Salovey-Caruso Emotional Intelligence Test (MSCEIT) as a measure of emotional intelligence. Emotion Review, 4, 394–402. doi:10.1177/1754073912445811
   Web of Science ®Google Scholar
• Mayer, J. D., Caruso, D., & Salovey, P. (1999). Emotional intelligence meets traditional standards for an intelligence. Intelligence, 27, 267–298. doi:10.1016/S0160-2896(99)00016-1
   Web of Science ®Google Scholar
• Mayer, J., Roberts, R. D., & Barsade, S. (2008). Human abilities: Emotional intelligence. Annual Review of Psychology, 59, 507–536. doi:10.1146/annurev.psych.59.103006.093646
   PubMed Web of Science ®Google Scholar
• Mayer, J. D., & Salovey, P. (1997). What is emotional intelligence? In P. Salovey, & D. J. Sluyter (Eds.), Emotional development and emotional intelligence: Educational implications (pp. 3–34). New York, NY: Basic Books.
   Google Scholar
• Mayer, J. D., Salovey, P., & Caruso, D. (2002). The Mayer, Salovey, and Caruso Emotional Intelligence Test: Technical manual. Toronto: Multi-Health Systems.
   Google Scholar
• Mayer, J. D., Salovey, P., & Caruso, D. R. (2008). What is emotional intelligence and what does it predict? In P. Kyllonen, R. Roberts, & L. Stankov (Eds.), Extending intelligence (pp. 319–348). Mahwah, NJ: Lawrence Erlbaum.
   Google Scholar
• McDaniel, M. A., Hartman, N. S., Whetzel, D. L., & Grubb, W. L., III. (2007). Situational judgment tests, response instructions and validity: A meta-analysis. Personnel Psychology, 60, 63–91. doi:10.1111/j.1744-6570.2007.00065.x
   Web of Science ®Google Scholar
• McDaniel M. A., Morgeson, F. P., Finnegan, E. B., Campion, M. A., & Braverman, E. P. (2001). Predicting job performance using situational judgment tests: A clarification of the literature. Journal of Applied Psychology, 86, 730–740. doi:10.1037/0021-9010.86.4.730
   PubMed Web of Science ®Google Scholar
• McDaniel, M. A., & Nguyen, N. T. (2001). Situational judgment tests: A review of practice and constructs assessed. International Journal of Selection and Assessment, 9, 103–113. doi:10.1111/1468-2389.00167
   Web of Science ®Google Scholar
• McGrew, K. S. (2009). CHC theory and the human cognitive abilities project: Standing on the shoulders of the giants of psychometric intelligence research. Intelligence, 37, 1–10. doi:10.1016/j.intell.2008.08.004
   Web of Science ®Google Scholar
• Nowicki, S., & Carton, J. (1993). The measurement of emotional intensity from facial expressions. The Journal of Social Psychology, 133, 749–750. doi:10.1080/00224545.1993.9713934
   PubMed Web of Science ®Google Scholar
• Orchard, B., MacCann, C., Schulze, R., Matthews, G., Zeidner, M., & Roberts, R. D. (2009). New directions and alternative approaches to the measurement of emotional intelligence. In C. Stough, D. Saklofske & J. D. A. Parker (Eds.), Advances in the measurement of emotional intelligence (pp. 321–344). New York, NY: Springer Publishing.
   Google Scholar
• Preacher, K. J., & Hayes, A. F. (2008). Asymptotic and resampling strategies for assessing and comparing indirect effects in multiple mediator models. Behavior Research Methods, 40, 879–891. doi:10.3758/BRM.40.3.879
   PubMed Web of Science ®Google Scholar
• Roberts, R. D., Burrus, J., Betancourt, A. C., Holtzman, S., Libbrecht, N., MacCann, C., … Schulze, R. (2011). Multimedia assessment of emotional abilities: Development and validation. Unpublished technical report and data. Princeton, NJ: Educational Testing Service.
   Google Scholar
• Roberts, R. D., & Schulze, R., & MacCann, C. (2008). The measurement of emotional intelligence: A decade of progress? In G. Boyle, G. Matthews, & D. Saklofske (Eds.), The Sage handbook of personality theory and assessment (pp. 461–482). New York, NY: Sage.
   Google Scholar
• Roberts, R. D., Schulze, R., O'Brien, K., MacCann, C., Reid, J., & Maul, A. (2006). Exploring the validity of the Mayer-Salovey-Caruso emotional intelligence test (MSCEIT) with established emotions measures. Emotion, 6, 663–669. doi:10.1037/1528-3542.6.4.663
   PubMed Web of Science ®Google Scholar
• Rockstuhl, T., Ang, S., Ng, K. Y., Lievens, F., & Van Dyne, L. (2015). Putting judging situations into situational judgment tests: Evidence from intercultural multimedia SJTs. Journal of Applied Psychology, 100, 464–480. doi:10.1037/a0038098
   PubMed Web of Science ®Google Scholar
• Rubin, R. S., Munz, D. C., & Bommer, W. H. (2005). Leading from within: The effects of emotion recognition and personality on transformational leadership behavior. Academy of Management Journal, 48, 845–858. doi:10.5465/AMJ.2005.18803926
   Web of Science ®Google Scholar
• Sauter, D. A., Eisner, F., Calder, A. J., & Scott, S. K. (2010). Perceptual cues in nonverbal vocal expressions of emotion. The Quarterly Journal of Experimental Psychology, 63, 2251–2272. doi:10.1080/17470211003721642
   Web of Science ®Google Scholar
• Scherer, K. R., & Ellgring, H. (2007). Multimodal expression of emotion: Affect programs or componential appraisal patterns? Emotion, 7, 158–171. doi:10.1037/1528-3542.7.1.158
   PubMed Web of Science ®Google Scholar
• Schlegel, K., Grandjean, D., & Scherer, K. R. (2014). Introducing the Geneva emotion recognition test: An example of Rasch-based test development. Psychological Assessment, 26, 666–672. doi:10.1037/a0035246
   PubMed Web of Science ®Google Scholar
• Schmitt, D. P., Realo, A., Voracek, M., & Allik, J. (2008). Why can't a man be more like a woman? Sex differences in big five personality traits across 55 cultures. Journal of Personality and Social Psychology, 94, 168–182. doi:10.1037/0022-3514.94.1.168
   PubMed Web of Science ®Google Scholar
• Shrout, P. E., & Bolger, N. (2002). Mediation in experimental and nonexperimental studies: New procedures and recommendations. Psychological Methods, 7, 422–445. doi:10.1037/1082-989X.7.4.422
   PubMed Web of Science ®Google Scholar
• Skevington, S. M., Lotfy, M., & O'Connell, K. A. (2004). The world health organization's WHOQOL-BREF quality of life assessment: Psychometric properties and results of the international field trial. A report from the WHOQOL group. Quality of life Research, 13, 299–310. doi:10.1023/B:QURE.0000018486.91360.00
   PubMed Web of Science ®Google Scholar
• Steiger, J. H. (1980). Tests for comparing elements of a correlation matrix. Psychological Bulletin, 87, 245–251. doi:10.1037/0033-2909.87.2.245
   Web of Science ®Google Scholar
• Ververidis, D., & Kotropoulos, C. (2006). Emotional speech recognition: Resources, features, methods, and applications. Speech Communication, 48, 1162–1181. doi:10.1016/j.specom.2006.04.003
   Web of Science ®Google Scholar
• Weekley, J. A., & Jones, C. (1997). Video-based situational testing. Personnel Psychology, 50, 25–49. doi:10.1111/j.1744-6570.1997.tb00899.x
   Web of Science ®Google Scholar
• Whetzel, D. L., & McDaniel, M. A. (2009). Situational judgment tests: An overview of current research. Human Resource Management Review, 19, 188–202. doi:10.1016/j.hrmr.2009.03.007
   Web of Science ®Google Scholar
• Zimet, G. D., Dahlem, N. W., Zimet, S. G., & Farley, G. K. (1988). The multidimensional scale of perceived social support. Journal of Personality Assessment, 52, 30–41. doi:10.1207/s15327752jpa5201_2
   Web of Science ®Google Scholar