When CAT is not an option: complementary methods of test abbreviation for neurocognitive batteries

References

• Babcock, B., & Weiss, D. J. (2009). Termination criteria in computerized adaptive tests: Variable length CATs are not biased. In D. J. Weiss (Ed.), Proceedings of the 2009 GMAC Conference on Computerized Adaptive Testing. Retrieved September 25, 2020, from www.psych.umn.edu/psylabs/CATCentral/
   Google Scholar
• Bae, J. N., & Cho, M. J. (2004). Development of the Korean version of the geriatric depression scale and its short form among elderly psychiatric patients. Journal of Psychosomatic Research, 57(3), 297–305. https://doi.org/10.1016/j.jpsychores.2004.01.004
   PubMed Web of Science ®Google Scholar
• Bagley, C., & Mallick, K. (1978). Development of a short form of the Piers--harris self-concept scale. Educational Review, 30(3), 265–268. https://doi.org/10.1080/0013191780300309
   Web of Science ®Google Scholar
• Baker, R. T., Burton, D., Pickering, M. A., & Start, A. (2019). Confirmatory factor analysis of the disablement in the physically active scale and preliminary testing of short-form versions: A Calibration and validation study. Journal of Athletic Training, 54(3), 302–318. https://doi.org/10.4085/1062-6050-355-17
   PubMed Web of Science ®Google Scholar
• Bann, C. M., McCormack, L. A., Berkman, N. D., & Squiers, L. B. (2012). The health literacy skills instrument: A 10-item short form. Journal of Health Communication, 17(sup3), 191–202. https://doi.org/10.1080/10810730.2012.718042
   PubMed Web of Science ®Google Scholar
• Bezdicek, O., Červenková, M., Moore, T. M., Stepankova Georgi, H., Sulc, Z., Wolk, D. A., Weintraub, D. A., Moberg, P. J., Jech, R., Kopecek, M., & Roalf, D. R. (2020). Determining a short form Montreal cognitive assessment (s-MoCA) Czech version: Validity in mild cognitive impairment parkinson’s disease and cross-cultural comparison. Assessment, https://doi.org/10.1177/1073191118778896
   Google Scholar
• Bock, R. D., & Aitkin, M. (1981). Marginal maximum likelihood estimation of item parameters: Application of an EM algorithm. Psychometrika, 46(4), 443–459. https://doi.org/10.1007/BF02293801
   Web of Science ®Google Scholar
• Cai, L. (2010). High-dimensional exploratory item factor analysis by A Metropolis–hastings robbins–monro algorithm. Psychometrika, 75(1), 33–57. https://doi.org/10.1007/s11336-009-9136-x
   Web of Science ®Google Scholar
• Calamia, M., Markon, K., Denburg, N. L., & Tranel, D. (2011). Developing a short form of Benton's Judgment of Line Orientation test: An item response theory approach. The Clinical Neuropsychologist, 25(4), 670–684. https://doi.org/10.1080/13854046.2011.564209
   PubMed Web of Science ®Google Scholar
• Calkins, M. E., Merikangas, K. R., Moore, T. M., Burstein, M., Behr, M. A., Satterthwaite, T. D., Ruparel, K., Wolf, D. H., Roalf, D. R., Mentch, F. D., Qiu, H., Chiavacci, R., Connolly, J. J., Sleiman, P. M. A., Gur, R. C., Hakonarson, H., & Gur, R. E. (2015). The Philadelphia neurodevelopmental cohort: Constructing a deep phenotyping collaborative. Journal of Child Psychology and Psychiatry, 56(12), 1356–1369. https://doi.org/10.1111/jcpp.12416
   PubMed Web of Science ®Google Scholar
• Calkins, M. E., Moore, T. M., Merikangas, K. R., Burstein, M., Satterthwaite, T. D., Bilker, W. B., Ruparel, K., Chiavacci, R., Wolf, D. H., Mentch, F., Qiu, H., Connolly, J. J., Sleiman, P. A., Hakonarson, H., Gur, R. C., & Gur, R. E. (2014). The psychosis spectrum in a young U. S. community sample: Findings from the philadelphia neurodevelopmental cohort. World Psychiatry, 13(3), 296–305. https://doi.org/10.1002/wps.20152
   PubMed Web of Science ®Google Scholar
• Cattell, R. B. (1966). The scree test for the number of factors. Multivariate Behavioral Research, 1(2), 245–276. https://doi.org/10.1207/s15327906mbr0102_10
   PubMed Web of Science ®Google Scholar
• Chang, H.-H. (2015). Psychometrics behind computerized adaptive testing. Psychometrika, 80(1), 1–20. https://doi.org/10.1007/s11336-014-9401-5
   PubMed Web of Science ®Google Scholar
• Chang, H.-H., & Ying, Z. (1999). a-stratified multistage computerized adaptive testing. Applied Psychological Measurement, 23(3), 211–222. https://doi.org/10.1177/01466219922031338
   Web of Science ®Google Scholar
• Choi, S. W. (2009). Firestar: Computerized adaptive testing simulation program for polytomous item response theory models. Applied Psychological Measurement, 33(8), 644–645. https://doi.org/10.1177/0146621608329892
   Web of Science ®Google Scholar
• Choi, S. W., Reise, S. P., Pilkonis, P. A., Hays, R. D., & Cella, D. (2010). Efficiency of static and computer adaptive short forms compared to full-length measures of depressive symptoms. Quality of Life Research, 19(1), 125–136. https://doi.org/10.1007/s11136-009-9560-5
   PubMed Web of Science ®Google Scholar
• Claparède, E. (1919). Percentilage de quelques tests d'aptitude. Archives de Psychologie, 17, 313. https://search.proquest.com/docview/1305203685
   Google Scholar
• Cole, J. C., Rabin, A. S., Smith, T. L., & Kaufman, A. S. (2004). Development and validation of a Rasch-derived CES-D short form. Psychological Assessment, 16(4), 360. https://doi.org/10.1037/1040-3590.16.4.360
   PubMed Web of Science ®Google Scholar
• Colledani, D., Anselmi, P., & Robusto, E. (2019). Development of a new abbreviated form of the Eysenck personality questionnaire-revised with multidimensional item response theory. Personality and Individual Differences, 149, 108–117. https://doi.org/10.1016/j.paid.2019.05.044
   Web of Science ®Google Scholar
• Dunkel, D., Antretter, E., Fröhlich-Walser, S., & Haring, C. (2005). Evaluation of the short-form social support questionnaire (SOZU-K-22) in clinical and non-clinical samples. Psychotherapie, Psychosomatik, Medizinische Psychologie, 55(5), 266–277. https://doi.org/10.1055/s-2004-834746
   PubMed Web of Science ®Google Scholar
• Eggen, T. J. H. M. (2001). Overexposure and underexposure of items in computerized adaptive testing. Measurement and Research Department Reports, 1.
   Google Scholar
• Embretson, S. E., & Reise, S. P. (2009). Item response theory for psychologists (Repr. ed.). Erlbaum.
   Google Scholar
• Francis, L. J., Brown, L. B., & Philipchalk, R. (1992). The development of an abbreviated form of the Revised Eysenck Personality Questionnaire (EPQR-A): Its use among students in England, Canada, the USA and Australia. Personality and Individual Differences, 13(4), 443–449. https://doi.org/10.1016/0191-8869(92)90073-X
   Web of Science ®Google Scholar
• Geil, G. A. (1945). A clinically useful abbreviated Wechsler-Bellevue scale. The Journal of Psychology, 20(1), 101–108. https://doi.org/10.1080/00223980.1945.9712764
   Web of Science ®Google Scholar
• Gibbons, R D, Weiss, D J, Pilkonis, P A, Frank, E, Moore, T, Kim, J B, & Kupfer, D J. (2012). Development of a computerized adaptive test for depression. Archives of General Psychiatry, 69(11), 1104–1112
   PubMed Web of Science ®Google Scholar
• Glorfeld, L. W. (1995). An improvement on Horn's parallel analysis methodology for selecting the correct number of factors to retain. Educational and Psychological Measurement, 55(3), 377–393. https://doi.org/10.1177/0013164495055003002
   Web of Science ®Google Scholar
• Gur, R. C., Ragland, J. D., Moberg, P. J., Turner, T. H., Bilker, W. B., Kohler, C., … Gur, R. E. (2001). Computerized neurocognitive scanning: I. Methodology and validation in healthy people. Neuropsychopharmacology: Official Publication of the American College of Neuropsychopharmacology, 25(5), 766–776. https://doi.org/10.1016/S0893-133X(01)00278-0
   PubMed Web of Science ®Google Scholar
• Gur, R. C., Richard, J., Hughett, P., Calkins, M. E., Macy, L., Bilker, W. B., Brensinger, C., & Gur, R. E. (2010). A cognitive neuroscience-based computerized battery for efficient measurement of individual differences: Standardization and initial construct validation. Journal of Neuroscience Methods, 187(2), 254–262. https://doi.org/10.1016/j.jneumeth.2009.11.017
   PubMed Web of Science ®Google Scholar
• Harris, J G. (1975). An abbreviated form of the Phillips Rating Scale of Premorbid Adjustment in schizophrenia. Journal of Abnormal Psychology, 84(2), 129.
   PubMed Web of Science ®Google Scholar
• Hau, K., & Chang, H.-H. (2001). Item selection in computerized adaptive testing: Should more discriminating items be used first? Journal of Educational Measurement, 38(3), 249–266. https://doi.org/10.1111/j.1745-3984.2001.tb01126.x
   Web of Science ®Google Scholar
• Hibbard, J. H., Mahoney, E. R., Stockard, J., & Tusler, M. (2005). Development and testing of a short form of the patient activation measure. Health Services Research, 40(6p1), 1918–1930. https://doi.org/10.1111/j.1475-6773.2005.00438.x
   PubMed Web of Science ®Google Scholar
• Hol, A. M., Vorst, H. C. M., & Mellenbergh, G. J. (2007). Computerized adaptive testing for polytomous motivation items: Administration mode effects and a comparison with short forms. Applied Psychological Measurement, 31(5), 412–429. https://doi.org/10.1177/0146621606297314
   Web of Science ®Google Scholar
• Jamison, R. N., Fanciullo, G. J., McHugo, G. J., & Baird, J. C. (2007). Validation of the short-form interactive computerized quality of life scale (ICQOL-SF). Pain Medicine, 8(3), 243–250. https://doi.org/10.1111/j.1526-4637.2006.00142.x
   PubMed Web of Science ®Google Scholar
• Joseph, S., Linley, P. A., Harwood, J., Lewis, C. A., & McCollam, P. (2004). Rapid assessment of well-being: The short depression-happiness scale (SDHS). Psychology and Psychotherapy: Theory, Research and Practice, 77(4), 463–478. https://doi.org/10.1348/1476083042555406
   PubMed Web of Science ®Google Scholar
• Krueger, R. F. (1999). The structure of common mental disorders. Archives of General Psychiatry, 56(10), 921–926. https://doi.org/10.1001/archpsyc.56.10.921
   PubMed Web of Science ®Google Scholar
• Kurtz, M. M., Ragland, J. D., Moberg, P. J., & Gur, R. C. (2004). The penn conditional exclusion test: A new measure of executive-function with alternate forms for repeat administration. Archives of Clinical Neuropsychology, 19(2), 191–201. https://doi.org/10.1016/S0887-6177(03)00003-9
   PubMed Web of Science ®Google Scholar
• Lawson, G. M., Moore, T. M., Okamura, K. H., Becker-Haimes, E. M., & Beidas, R. S. (2020). Knowledge of evidence-based services questionnaire: Development and validation of a short form. Administration and Policy in Mental Health and Mental Health Services Research, 47, 581–596. https://doi.org/10.1007/s10488-020-01020-7
   PubMed Web of Science ®Google Scholar
• Manos, R. C., Kanter, J. W., & Luo, W. (2011). The behavioral activation for depression scale–short form: Development and validation. Behavior Therapy, 42(4), 726–739. https://doi.org/10.1016/j.beth.2011.04.004
   PubMed Web of Science ®Google Scholar
• Mizumoto, A., Sasao, Y., & Webb, S. A. (2019). Developing and evaluating a computerized adaptive testing version of the word part levels test. Language Testing, 36(1), 101–123. https://doi.org/10.1177/0265532217725776
   Web of Science ®Google Scholar
• Moore, T. M., Calkins, M. E., Satterthwaite, T. D., Roalf, D. R., Rosen, A. F. G., Gur, R. C., & Gur, R. E. (2019). Development of a computerized adaptive screening tool for overall psychopathology (“p”). Journal of Psychiatric Research, 116, 26–33. https://doi.org/10.1016/j.jpsychires.2019.05.028
   PubMed Web of Science ®Google Scholar
• Moore, T. M., Martin, I. K., Gur, O. M., Jackson, C. T., Scott, J. C., Calkins, M. E., Ruparel, K., Port, A. M., Nivar, I., Krinsky, H. D., Gur, R. E., & Gur, R. C. (2016). Characterizing social environment's association with neurocognition using census and crime data linked to the Philadelphia neurodevelopmental cohort. Psychological Medicine, 46(3), 599–610. https://doi.org/10.1017/S0033291715002111
   PubMed Web of Science ®Google Scholar
• Moore, T. M., Scott, J. C., Reise, S. P., Port, A. M., Jackson, C. T., Ruparel, K., Savitt, A. P., Gur, R. E., & Gur, R. C. (2015). Development of an abbreviated form of the penn line orientation test using large samples and computerized adaptive test simulation. Psychological Assessment, 27(3), 955–964. https://doi.org/10.1037/pas0000102
   PubMed Web of Science ®Google Scholar
• Owen, A. M., McMillan, K. M., Laird, A. R., & Bullmore, E. (2005). N-back working memory paradigm: A meta-analysis of normative functional neuroimaging studies. Human Brain Mapping, 25(1), 46–59. https://doi.org/10.1002/hbm.20131
   PubMed Web of Science ®Google Scholar
• Paap, M. C., Born, S., & Braeken, J. (2019). Measurement efficiency for fixed-precision multidimensional computerized adaptive tests: Comparing health measurement and educational testing using example banks. Applied Psychological Measurement, 43(1), 68–83. https://doi.org/10.1177/0146621618765719
   PubMed Web of Science ®Google Scholar
• Peters, L., Sunderland, M., Andrews, G., Rapee, R. M., & Mattick, R. P. (2012). Development of a short form Social Interaction anxiety (SIAS) and Social Phobia scale (SPS) using nonparametric item response theory: The SIAS-6 and the SPS-6. Psychological Assessment, 24(1), 66. https://doi.org/10.1037/a0024544
   PubMed Web of Science ®Google Scholar
• Ragland, J. D., Turetsky, B. I., Gur, R. C., Gunning-Dixon, F., Turner, T., Schroeder, L., Chan, R., & Gur, R. E. (2002). Working memory for complex figures: An fMRI comparison of letter and fractal n-back tasks. Neuropsychology, 16(3), 370–379. https://doi.org/10.1037//0894-4105.16.3.370
   PubMed Web of Science ®Google Scholar
• Reise, S. P. (2012). The rediscovery of bifactor measurement models. Multivariate Behavioral Research, 47(5), 667–696. https://doi.org/10.1080/00273171.2012.715555
   PubMed Web of Science ®Google Scholar
• Reise, S. P., & Henson, J. M. (2000). Computerization and adaptive administration of the NEO PIR. Assessment, 7(4), 347–364. https://doi.org/10.1177/107319110000700404
   PubMed Web of Science ®Google Scholar
• Reise, S. P., Moore, T. M., & Haviland, M. G. (2010). Bifactor models and rotations: Exploring the extent to which multidimensional data yield univocal scale scores. Journal of Personality Assessment, 92(6), 544–559. https://doi.org/10.1080/00223891.2010.496477
   PubMed Web of Science ®Google Scholar
• Reise, S. P., Waller, N. G., & Comrey, A. L. (2000). Factor analysis and scale revision. Psychological Assessment, 12(3), 287. https://doi.org/10.1037/1040-3590.12.3.287
   PubMed Web of Science ®Google Scholar
• Reitan, R. M. (1955). The relation of the trail making test to organic brain damage. Journal of Consulting Psychology, 19(5), 393. https://doi.org/10.1037/h0044509
   PubMedGoogle Scholar
• Revuelta, J., & Ponsoda, V. (1998). A comparison of item exposure control methods in computerized adaptive testing. Journal of Educational Measurement, 35(4), 311–327. https://doi.org/10.1111/j.1745-3984.1998.tb00541.x
   Web of Science ®Google Scholar
• Riccio, C. A., Lowe, P. A., & Reynolds, C. R. (2004). Clinical applications of continuous performance tests (1nd. Aufl. ed.). Wiley. http://ebooks.ciando.com/book/index.cfm/bok_id/493195
   Google Scholar
• Roalf, D. R., Moore, T. M., Wolk, D. A., Arnold, S. E., Mechanic-Hamilton, D., Rick, J., Kabadi, S., Ruparel, K., Chen-Plotkin, A. S., Chahine, L. M., Dahodwala, N. A., Duda, J. E., Weintraub, D. A., & Moberg, P. J. (2016). Defining and validating a short form Montreal cognitive assessment (s-MoCA) for use in neurodegenerative disease. Journal of Neurology, Neurosurgery & Psychiatry, 87(12), 1303–1310. https://doi.org/10.1136/jnnp-2015-312723
   PubMed Web of Science ®Google Scholar
• Robbins, T. W., James, M., Owen, A. M., Sahakian, B. J., McInnes, L., & Rabbitt, P. (1994). Cambridge neuropsychological test automated battery (CANTAB): A factor analytic study of a large sample of normal elderly volunteers. Dementia (Basel, Switzerland), 5(5), 266. https://doi.org/10.1159/000106735
   PubMedGoogle Scholar
• Saine, M. E., Moore, T. M., Szymczak, J. E., Bamford, L. P., Barg, F. K., Mitra, N., Schnittker, J., Holmes, J. H., Lo Re, V., & Tu, W.-J. (2020). Validation of a modified Berger HIV stigma scale for use among patients with hepatitis C virus (HCV) infection. Plos one, 15(2), e0228471. https://doi.org/10.1371/journal.pone.0228471
   PubMed Web of Science ®Google Scholar
• Satterthwaite, T. D., Connolly, J. J., Ruparel, K., Calkins, M. E., Jackson, C., Elliott, M. A., Roalf, D. R., Hopson, R., Prabhakaran, K., Behr, M., Qiu, H., Mentch, F. D., Chiavacci, R., Sleiman, P. M. A., Gur, R. C., Hakonarson, H., & Gur, R. E. (2016). The Philadelphia neurodevelopmental cohort: A publicly available resource for the study of normal and abnormal brain development in youth. NeuroImage, 124(Pt B), 1115–1119. https://doi.org/10.1016/j.neuroimage.2015.03.056
   PubMedGoogle Scholar
• Satterthwaite, T. D., Elliott, M. A., Ruparel, K., Loughead, J., Prabhakaran, K., Calkins, M. E., Hopson, R., Jackson, C., Keefe, J., Riley, M., Mentch, F. D., Sleiman, P., Verma, R., Davatzikos, C., Hakonarson, H., Gur, R. C., & Gur, R. E. (2014). Neuroimaging of the Philadelphia neurodevelopmental cohort. NeuroImage, 86, 544–553. https://doi.org/10.1016/j.neuroimage.2013.07.064
   PubMed Web of Science ®Google Scholar
• Scalise, K., & Allen, D. D. (2015). Use of open-source software for adaptive measurement: Concerto as an R-based computer adaptive development and delivery platform. British Journal of Mathematical and Statistical Psychology, 68(3), 478–496. https://doi.org/10.1111/bmsp.12057
   PubMed Web of Science ®Google Scholar
• Shaffer, D., Gould, M. S., Brasic, J., Ambrosini, P., Fisher, P., Bird, H., & Aluwahlia, S. (1983). A children’s global assessment scale (CGAS). Archives of General Psychiatry, 40(11), 1228–1231. https://doi.org/10.1001/archpsyc.1983.01790100074010
   PubMed Web of Science ®Google Scholar
• Shanmugan, S., Wolf, D. H., Calkins, M. E., Moore, T. M., Ruparel, K., Hopson, R. D., Vandekar, S. N., Roalf, D. R., Elliott, M. A., Jackson, C., Gennatas, E. D., Leibenluft, E., Pine, D. S., Shinohara, R. T., Hakonarson, H., Gur, R. C., Gur, R. E., & Satterthwaite, T. D. (2016). Common and dissociable mechanisms of executive system dysfunction across psychiatric disorders in youth. American Journal of Psychiatry, 173(5), 517–526. https://doi.org/10.1176/appi.ajp.2015.15060725
   PubMed Web of Science ®Google Scholar
• Slocum-Gori, S. L., & Zumbo, B. D. (2011). Assessing the unidimensionality of psychological scales: Using multiple criteria from factor analysis. Social Indicators Research, 102(3), 443–461. https://doi.org/10.1007/s11205-010-9682-8
   Web of Science ®Google Scholar
• Straus, M. A., & Douglas, E. M. (2004). A short form of the revised conflict tactics scales, and typologies for severity and mutuality. Violence and Victims, 19(5), 507–520. https://doi.org/10.1891/vivi.19.5.507.63686
   PubMedGoogle Scholar
• Sturm, A., Kuhfeld, M., Kasari, C., & McCracken, J. T. (2017). Development and validation of an item response theory-based Social Responsiveness scale short form. Journal of Child Psychology and Psychiatry, 58(9), 1053–1061. https://doi.org/10.1111/jcpp.12731
   PubMed Web of Science ®Google Scholar
• Sudlow, C., Gallacher, J., Allen, N., Beral, V., Burton, P., Danesh, J., Downey, P., Elliott, P., Green, J., Landray, M., Liu, B., Matthews, P., Ong, G., Pell, J., Silman, A., Young, A., Sprosen, T., Peakman, T., & Collins, R. (2015). UK biobank: An open access resource for identifying the causes of a wide range of complex diseases of middle and old age. PLoS Medicine, 12(3), e1001779. https://doi.org/10.1371/journal.pmed.1001779
   PubMed Web of Science ®Google Scholar
• Thomas, M. L., Brown, G. G., Gur, R. C., Moore, T. M., Patt, V. M., Risbrough, V. B., & Baker, D. G. (2018). A signal detection–item response theory model for evaluating neuropsychological measures. Journal of Clinical and Experimental Neuropsychology, 40(8), 745–760. https://doi.org/10.1080/13803395.2018.1427699
   PubMed Web of Science ®Google Scholar
• Velicer, W. F. (1976). Determining the number of components from the matrix of partial correlations. Psychometrika, 41(3), 321–327. https://doi.org/10.1007/BF02293557
   Web of Science ®Google Scholar
• Wainer, H. (2000). Computerized adaptive testing (2nd ed.). Erlbaum.
   Google Scholar
• Ward, T., Arnold, K., Cunningham, M. C., & Liljequist, L. (2018). Three validation studies of the personality assessment inventory short form. Journal of Clinical Psychology, 74(12), 2264–2275. https://doi.org/10.1002/jclp.22677
   PubMed Web of Science ®Google Scholar
• Whitman, Z. R., Kachali, H., Roger, D., Vargo, J., & Seville, E. (2013). Short-form version of the Benchmark Resilience Tool (BRT-53). Measuring Business Excellence.
   Google Scholar
• Yudien, M. A., Moore, T. M., Port, A. M., Ruparel, K., Gur, R. E., & Gur, R. C. (2019). Development and public release of the Penn reading assessment computerized adaptive test (PRA-CAT) for premorbid IQ. Psychological Assessment, 31(9), 1168–1173. doi:10.1037/pas0000738
   PubMed Web of Science ®Google Scholar