The Impact of Different Thematic Apperception Test Administration Methods on Narrative Length and Story Richness as Measured by the Social Cognition and Object Relations Scale-Global Rating Method (SCORS-G)

References

• Ackerman, S. J., Clemence, A. J., Weatherill, R., & Hilsenroth, M. J. (1999). Use of the TAT in the assessment of DSM-IV cluster B personality disorders. Journal of Personality Assessment, 73(3), 422–448. https://doi.org/10.1207/S15327752JPA7303_9
   PubMed Web of Science ®Google Scholar
• Adams, B. E., Porcerelli, J. H., Abell, S., & Huprich, S. K. (2021). Malevolent object relations: A multimethod study of female survivors of childhood abuse. Personality and Mental Health, 15(4), 252–260. https://doi.org/10.1002/pmh.1512
   PubMed Web of Science ®Google Scholar
• Alvarado, N. (1994). Empirical validity of the Thematic Apperception Test. Journal of Personality Assessment, 63(1), 59–79. https://doi.org/10.1207/s15327752jpa6301_5
   Web of Science ®Google Scholar
• Aronow, E., Weiss, K. A., & Reznikoff, M. (2013). A practical guide to the Thematic Apperception Test the TAT in clinical practice. Taylor and Francis.
   Google Scholar
• Augusta University. (2021). Data USA. https://datausa.io/profile/university/augusta-university#enrollment_status
   Google Scholar
• Baer, J. D., Cook, A. L., Baldi, S. (2006). The literacy of America’s college students. The National Survey of America’s College Students. https://www.air.org/sites/default/files/The-Literacy-of-Americas-College-Students-Jan-2006.pdf
   Google Scholar
• Bailey, B. E., & Green, J. (1977). Black thematic apperception test-stimulus material. Journal of Personality Assessment, 41(1), 25–30. https://doi.org/10.1207/s15327752jpa4101_4
   PubMed Web of Science ®Google Scholar
• Baty, M. A., & Dreger, R. M. (1975). A comparison of three methods to record TAT protocols. Journal of Clinical Psychology, 31(2), 348–348. https://doi.org/10.1002/1097-4679(197504)31:2<348::AID-JCLP2270310241>3.0.CO;2-Q
   PubMed Web of Science ®Google Scholar
• Bernecker, K., & Job, V. (2011). Assessing implicit motives with an online version of the picture story exercise. Motivation and Emotion, 35(3), 251–266. https://doi.org/10.1007/s11031-010-9175-8
   Web of Science ®Google Scholar
• Bernstein, L. (1956). The examiner as an inhibiting factor in clinical testing. Journal of Consulting Psychology, 20(4), 287–290. https://doi.org/10.1037/h0046357
   PubMedGoogle Scholar
• Blankenship, V., & Zoota, A. (1998). Comparing power imagery in TATs written by hand or on the computer. Behavior Research Methods, Instruments, and Computers, 30(3), 441–448. https://doi.org/10.3758/BF03200677
   Google Scholar
• Calabrese, M. L., Farber, B. A., & Westen, D. (2005). The relationship of adult attachment constructs to object relational patterns of representing self and others. The Journal of the American Academy of Psychoanalysis and Dynamic Psychiatry, 33(3), 513–530. https://doi.org/10.1521/jaap.2005.33.3.513
   PubMedGoogle Scholar
• Callahan, K. L., Price, J. L., & Hilsenroth, M. J. (2003). Psychological assessment of adult survivors of childhood sexual abuse within a naturalistic clinical sample. Journal of Personality Assessment, 80(2), 173–184. https://doi.org/10.1207/S15327752JPA8002_06
   PubMed Web of Science ®Google Scholar
• Cicchetti, D. V. (1981). Testing the normal approximation and minimal sample size requirements of weighted kappa when the number of categories is large. Applied Psychological Measurement, 5(1), 101–104. https://doi.org/10.1177/014662168100500114
   Web of Science ®Google Scholar
• Cicchetti, D. V. (1994). Guidelines, criteria, and rules of thumb for evaluating normed and standardized assessment instruments in psychology. Psychological Assessment, 6(4), 284–290. https://doi.org/10.1037/1040-3590.6.4.284
   Google Scholar
• Cohen, J. (1992). A power primer. Psychological Bulletin, 112(1), 155–159. https://doi.org/10.1037//0033-2909.112.1.155
   PubMed Web of Science ®Google Scholar
• Costantino, G., & Malgady, R. G. (1996). Development of TEMAS, a multicultural Thematic Apperception Test: Psychometric properties and clinical utility. In G. R. Sodowsky & J. C. Impara (Eds.), Multicultural assessment in counseling and clinical psychology (pp. 85–136). Buros Center for Testing.
   Google Scholar
• Cowan, G., & Goldberg, F. J. (1967). Need achievement as a function of the race and sex of figures of selected TAT cards. Journal of Personality and Social Psychology, 5(2), 245–249. https://doi.org/10.1037/h0021204
   Web of Science ®Google Scholar
• Cramer, P. (1991). The development of defense mechanisms: Theory, research and assessment. Springer-Verlag.
   Google Scholar
• Dana, R. H. (1999). Cross-cultural-multicultural use of the Thematic Apperception Test. In L. Gieser & M. I. Stein (Eds.), Evocative images: The thematic apperception test and the art of projection (pp. 177–190). American Psychological Association. https://doi.org/10.1037/10334-013
   Google Scholar
• de Winter, J. C. F., & Dodou, D. (2012). Factor recovery by principal axis factoring and maximum likelihood factor analysis as a function of factor pattern and sample size. Journal of Applied Statistics, 39(4), 695–710. https://doi.org/10.1080/02664763.2011.610445
   Web of Science ®Google Scholar
• Eron, L. D., & Ritter, A. M. (1951). A comparison of two methods of administration of the thematic apperception test. Journal of Consulting Psychology, 15(1), 55–61. https://doi.org/10.1037/h0055329
   PubMedGoogle Scholar
• Exner, J. E. (1995). The Rorschach: A comprehensive system. Vol. 1: Basic foundations. Wiley.
   Google Scholar
• Fantini, F., Williams, R., Abbate, L., & Ortu, F. (2013). Measuring object relations and cognitive development in adolescence: A socio-cognitive perspective. Infanzia e Adolescenza, 12(1), 2–11.
   Google Scholar
• Faul, F., Erdfelder, E., Buchner, A., & Lang, A.-G. (2009). Statistical power analyses using G*Power 3.1: Tests for correlation and regression analyses. Behavior Research Methods, 41(4), 1149–1160. https://doi.org/10.3758/BRM.41.4.1149
   PubMed Web of Science ®Google Scholar
• Fleiss, J. L. (1975). Measuring agreement between two judges on the presence or absence of a trait. Biometrics, 31(3), 651–659. https://doi.org/10.2307/2529549
   PubMed Web of Science ®Google Scholar
• Fleiss, J. L. (1981). Statistical methods for rates and proportions (2nd ed.). Wiley.
   Google Scholar
• Fleiss, J. L., & Cohen, J. (1973). The equivalence of weighted kappa and the intraclass correlation coefficient as measures of reliability. Educational and Psychological Measurement, 33(3), 613–619. https://doi.org/10.1177/001316447303300309
   Web of Science ®Google Scholar
• Fowler, J. C., Ackerman, S. J., Speanburg, S., Bailey, A., Blagys, M., & Conklin, A. C. (2004). Personality and symptom change in treatment-refractory inpatients: Evaluation of the phase model of change using Rorschach, TAT, and DSM-IV Axis V. Journal of Personality Assessment, 83(3), 306–322. https://doi.org/10.1207/s15327752jpa8303_12
   PubMed Web of Science ®Google Scholar
• Fowler, C., Hilsenroth, M. J., & Handler, L. (1996). Two methods of early memories data collection: An empirical comparison of the projective yield. Assessment, 3(1), 63–71. https://doi.org/10.1177/107319119600300107
   Google Scholar
• Gruber, N., & Kreuzpointner, L. (2015). Assessing the implicit achievement motive: Effects of input-condition, administration and picture -position. International Journal of Psychology and Educational Studies, 2(3), 10–19. https://doi.org/10.17220/ijpes.2015.03.002
   Google Scholar
• Hayes, A. F., Coutts, J. J. (2020). Use omega rather than Cronbach’s alpha for estimating reliability. But…. Communication Methods and Measures, 14(1), 1–24. https://doi.org/10.1080/19312458.2020.1718629
   Web of Science ®Google Scholar
• Augusta University. (2022). Jags First #AUFIRSTGEN. https://www.augusta.edu/newjags/first-gen
   Google Scholar
• JASP Team (2023). JASP (Version 0.17.3) [Computer software]. https://jasp-stats.org/download/
   Google Scholar
• Jarrard, C., Widner, S., Johnson, J. A., Stein, M. B., Perkey, H., & Slavin-Mulford, J. (2023). Predicting client-rated session depth and alliance in trainees’ first clinical encounter: The contribution of therapist characteristics and technique usage. Training and Education in Professional Psychology, https://doi.org/10.1037/tep0000454
   Web of Science ®Google Scholar
• Jenkins, S. R. (2008). A handbook of clinical scoring systems for the thematic apperceptive techniques. Taylor & Francis.
   Google Scholar
• Jowers, C. E., Cain, L. A., Hoffman, Z. T., Perkey, H., Stein, M. B., Widner, S. C., & Slavin-Mulford, J. (2019). The relationship between trainee therapist traits with the use of self-disclosure and immediacy in psychotherapy. Psychotherapy, 56(2), 157–169. https://doi.org/10.1037/pst0000225
   PubMed Web of Science ®Google Scholar
• Langford, L. (2022, April 21). Thematic Apperception Test (TAT). Study.com. Retrieved July 4, 2022, from https://study.com/learn/lesson/thematic-apperception-test-overview-examples.html
   Google Scholar
• Lewis, K. C., & Clemence, A. J. (2023). Clinical use of the Thematic Apperception Test and other non-normed idiographic assessment methods. In J. L. Mihura (Ed.), The Oxford handbook of personality and psychopathology assessment (2nd ed., pp. C17S1–C17S20). Oxford University Press. https://doi.org/10.1093/oxfordhb/9780190092689.013.17
   Google Scholar
• Lewis, K. C., Ridenour, J. M., Pitman, S., & Roche, M. (2021). Evaluating stable and situational expressions of passive-aggressive personality disorder: A multimethod experience sampling case study. Journal of Personality Assessment, 103(4), 558–570. https://doi.org/10.1080/00223891.2020.1818572
   PubMed Web of Science ®Google Scholar
• Lindzey, G., & Heinemann, S. H. (1955). Thematic apperception test: Individual and group administration. Journal of Personality, 24(1), 34–55. https://doi.org/10.1111/j.1467-6494.1955.tb01173.x
   PubMed Web of Science ®Google Scholar
• McClelland, D. C., Atkinson, J. W., Clark, R. A., & Lowell, E. L. (1953). The achievement motive. Appleton-Century-Crofts. https://doi.org/10.1037/11144-000
   Google Scholar
• McClelland, D. C., Koestner, R., & Weinberger, J. (1989). How do self-attributed and implicit motives differ? Psychological Review, 96(4), 690–702. https://doi.org/10.1037/0033-295X.96.4.690
   Web of Science ®Google Scholar
• Meyer, G. J., Viglione, D. J., Mihura, J. L., Erard, R. E., & Erdberg, P. (2011). Rorschach performance assessment system: Administration, coding, interpretation, and technical manual. Rorschach Performance Assessment System.
   Google Scholar
• Morgan, C. D., & Murray, H. A. (1935). A method for investigating fantasies: The thematic apperception test. Archives of Neurology & Psychiatry, 34(2), 289–306. https://doi.org/10.1001/archneurpsyc.1935.02250200049005
   Google Scholar
• Mullin, A. S., Hilsenroth, M. J., Gold, J., & Farber, B. A. (2017). Changes in object relations over the course of psychodynamic psychotherapy. Clinical Psychology & Psychotherapy, 24(2), 501–511. https://doi.org/10.1002/cpp.2021
   PubMed Web of Science ®Google Scholar
• Murray, H. A. (1943). Manual for the thematic apperception test. Harvard University Press.
   Google Scholar
• Niec, L. N., & Russ, S. W. (2002). Children’s internal representations, empathy and fantasy play: A validity study of the SCORS-Q. Psychological Assessment, 14(3), 331–338. https://doi.org/10.1037/1040-3590.14.3.331
   PubMed Web of Science ®Google Scholar
• Peters, E. J., Hilsenroth, M. J., Eudell-Simmons, E. M., Blagys, M. D., & Handler, L. (2006). Reliability and validity of the social cognition and object relations scale in clinical use. Psychotherapy Research, 16(5), 617–626. https://doi.org/10.1080/10503300600591288
   Web of Science ®Google Scholar
• Pinet, S., Zielinski, C., Alario, F. X., & Longcamp, M. (2022). Typing expertise in a large student population. Cognitive Research: Principles and Implications, 7(1), 96. https://doi.org/10.1186/s41235-022-00424-3
   PubMed Web of Science ®Google Scholar
• Pituch, K. A., & Stevens, J. (2016). Applied multivariate statistics for the social sciences: Analyses with SAS and IBM's SPSS. Routledge, Taylor et Francis Group.
   Google Scholar
• Porcerelli, J. H., Dauphin, V. B., Ablon, J. S., Leitman, S., & Bambery, M. (2007). Psychoanalysis with avoidant personality disorder: A systematic case study. Psychotherapy , 44(1), 1–13. https://doi.org/10.1037/0033-3204.44.1.1
   PubMed Web of Science ®Google Scholar
• Ridenour, J. M., Lewis, K. C., Siefert, C. J., Pitman, S. R., Knauss, D., & Stein, M. B. (2021). Card pull effects of the thematic apperception test using the social cognition and object relations-global rating method on complex psychiatric sample. Clinical Psychology & Psychotherapy, 28(5), 1079–1090. https://doi.org/10.1002/cpp.2554
   PubMed Web of Science ®Google Scholar
• Ridenour, J. M., Lewis, K. C., Siefert, C. J., & Stein, M. B. (2022). Longitudinal stability of social cognition and object relations scale—global rating method dimensional ratings, score ranges and narrative ‘blandness’ in a clinical sample. Clinical Psychology & Psychotherapy, 29(4), 1447–1456. https://doi.org/10.1002/cpp.2729
   PubMed Web of Science ®Google Scholar
• Rowan-Kenyon, H. T., McCready, A. M., Alemán, A. M. M., & Yarri, A. (2022). “KWIM? BRB”: How do emerging adults communicate differently than previous generations? In T. A. Duncan & A. A. Buskirk-Cohen (Eds.), Cultivating student success: A multifaceted approach to working with emerging adults in higher education (pp. 68–81). Oxford University Press. https://doi.org/10.1093/oso/9780197586693.003.0006
   Google Scholar
• Schultheiss, O. C., Liening, S. H., & Schad, D. (2008). The reliability of a picture story exercise measure of implicit motives: Estimates of internal consistency, retest reliability, and ipsative stability. Journal of Research in Personality, 42(6), 1560–1571. https://doi.org/10.1016/j.jrp.2008.07.008
   Web of Science ®Google Scholar
• Shrout, P. E., & Fleiss, J. L. (1979). Intraclass correlations: Uses in assessing rater reliability. Psychological Bulletin, 86(2), 420–428. https://doi.org/10.1037/0033-2909.86.2.420
   PubMed Web of Science ®Google Scholar
• Siefert, C. J., Stein, M., Slavin-Mulford, J., Haggerty, G., Sinclair, S. J., Funke, D., & Blais, M. A. (2018). Exploring the factor structure of the social cognition and object relations-global rating method: Findings from a large heterogeneous sample. Journal of Personality Assessment, 100(2), 122–134. https://doi.org/10.1080/00223891.2017.1336716
   PubMed Web of Science ®Google Scholar
• Siefert, C. J., Stein, M. B., Slavin-Mulford, J., Sinclair, S. J., Haggerty, G., & Blais, M. A. (2016). Estimating the effects of thematic apperception test card content on SCORS–G ratings: Replication with a nonclinical sample. Journal of Personality Assessment, 98(6), 598–607. https://doi.org/10.1080/00223891.2016.1167696
   PubMed Web of Science ®Google Scholar
• Slavin-Mulford, J. M., Amerson, L. R., Cain, L. A., Hilsenroth, M. J., Wilcox, M. M., & Stein, M. B. (2021). How narrative source impacts convergence of ratings from the Social Cognition and Object Relations Scale–Global Rating Method with psychotherapy process measures. Clinical Psychology & Psychotherapy, 28(6), 1550–1561. https://doi.org/10.1002/cpp.2595
   PubMed Web of Science ®Google Scholar
• Slavin, J. M., Stein, M. B., Pinsker-Aspen, J. H., & Hilsenroth, M. J. (2007). Early memories from outpatients with and without a history of childhood sexual abuse. Journal of Loss and Trauma, 12(5), 435–451. https://doi.org/10.1080/15325020701273355
   Web of Science ®Google Scholar
• Slavin-Mulford, J. M., Amerson, L. R., Hilsenroth, M. J., Zodan, J., Charnas, J. W., Cain, L. A., & Stein, M. B. (2020). Are all narratives the same: Convergent and discriminant validity of the Social Cognition and Object Relations Scale—Global Rating Method across two narrative types. Clinical Psychology & Psychotherapy, 28(3), 623–632. https://doi.org/10.1002/cpp.2525
   PubMed Web of Science ®Google Scholar
• Smith, C. P. (Ed.). (1992). Motivation and personality: Handbook of thematic content analysis. Cambridge University Press.
   Google Scholar
• Stein, M. B., Calderon, S., Ruchensky, J., Massey, C., Slavin-Mulford, J., Chung, W. J., Richardson, L. A., & Blais, M. A. (2020). When’s a story a story? Determining interpretability of social cognition and object relations scale-global ratings on thematic apperception test narratives. Clinical Psychology & Psychotherapy, 27(4), 567–580. https://doi.org/10.1002/cpp.2442
   PubMed Web of Science ®Google Scholar
• Stein, M. B., Hilsenroth, M., Slavin-Mulford, J., & Pinsker-Aspen, J. (2019). Social cognition and object relations scale: Global rating method SCORS-G. (5th ed.). Massachusetts General Hospital and Harvard Medical School.
   Google Scholar
• Stein, M. B., & Siefert, C. J. (2018). Introduction to the special section on the Social Cognition and Object Relations Scale–Global Rating Method: From research to practice. Journal of Personality Assessment, 100(2), 117–121. https://doi.org/10.1080/00223891.2017.1418749
   PubMed Web of Science ®Google Scholar
• Stein, M. B., & Slavin-Mulford, J. (2018). the social cognition and object relations scale-global rating method (SCORS-G) A comprehensive guide for clinicians and researchers. Taylor and Francis.
   Google Scholar
• Stein, M. B., Slavin-Mulford, J., Sinclair, S. J., Siefert, C. J., & Blais, M. A. (2012). Exploring the construct validity of the Social Cognition and Object Relations Scale in a clinical sample. Journal of Personality Assessment, 94(5), 533–540. https://doi.org/10.1080/00223891.2012.668594
   PubMed Web of Science ®Google Scholar
• Stein, M. B., Slavin-Mulford, J., Siefert, C. J., Sinclair, S. J., Renna, M., Malone, J., Bello, I., & Blais, M. A. (2014). SCORS–G stimulus characteristics of select thematic apperception test cards. Journal of Personality Assessment, 96(3), 339–349. https://doi.org/10.1080/00223891.2013.823440
   PubMed Web of Science ®Google Scholar
• Stricker, G., & Lally, S. J. (2015). Projective methods in psychology. In J. D. Wright (Ed.), International encyclopedia of the social & behavioral sciences (2nd ed., pp. 129–134). Elsevier. https://doi.org/10.1016/B978-0-08-097086-8.21035-0
   Google Scholar
• Tabachnick, B. G., & Fidell, L. S. (2007). Using multivariate statistics (5th ed.). Pearson.
   Google Scholar
• Terry, D. (1952). The use of a rating scale of level of response in TAT stories. Journal of Abnormal Psychology, 47(2 Suppl), 507–511. https://doi.org/10.1037/h0056626
   PubMed Web of Science ®Google Scholar
• Tran, X., & Ralston, L. (2006). Tourist preferences influence of unconscious needs. Annals of Tourism Research, 33(2), 424–441. https://doi.org/10.1016/j.annals.2005.10.014
   Web of Science ®Google Scholar
• Westen, D., Barends, A., Leigh, M., Mendel, M., & Silbert, D. (1990). Social Cognition and Object Relations Scale (SCORS): Manual for coding interview data. University of Michigan.
   Google Scholar
• Westen, D., Klepser, J., Ruffins, S. A., Silverman, M., Lifton, N., & Boekamp, J. (1991). Object relations in childhood and adolescence: The development of working representations. Journal of Consulting and Clinical Psychology, 59(3), 400–409. https://doi.org/10.1037/0022-006x.59.3.400
   PubMed Web of Science ®Google Scholar
• Westen, D., Silk, K., Lohr, N., & Kerber, K. (1985–1990). Object relations and social cognition: TAT scoring manual. University of Michigan.
   Google Scholar
• Westen, D. (1989). Are “primitive” object relations really preoedipal? The American Journal of Orthopsychiatry, 59(3), 331–345. https://doi.org/10.1111/j.1939-0025.1989.tb01669.x
   PubMed Web of Science ®Google Scholar
• Westen, D. (1991). Social cognition and object relations. Psychological Bulletin, 109(3), 429–455. https://doi.org/10.1037/0033-2909.109.3.429
   Web of Science ®Google Scholar
• Westen, D. (1995). Social cognition and object relations scale: Q-sort for projective stories (SCORS–Q). Department of Psychiatry, The Cambridge Hospital and Harvard Medical School.
   Google Scholar
• Wiarda, N. R., McMinn, M. R., Peterson, M. A., & Gregor, J. A. (2014). Use of technology for note taking and therapeutic alliance. Psychotherapy, 51(3), 443–446. https://doi.org/10.1037/a0035075
   PubMed Web of Science ®Google Scholar