A Comparison of Limited-Information Test Statistics for a Response Style MIRT Model

References

• Adams, D. J., Bolt, D. M., Deng, S., Smith, S. S., & Baker, T. B. (2019). Using multidimensional item response theory to evaluate how response styles impact measurement. The British Journal of Mathematical and Statistical Psychology, 72(3), 466–485. https://doi.org/10.1111/bmsp.12169
   PubMed Web of Science ®Google Scholar
• Agresti, A. (1996). An introduction to categorical data analysis. Wiley. https://doi.org/10.1002/9780470114759
   Google Scholar
• Bacher, J. (1995). Goodness-of-fit measures for multiple correspondence analysis. Quality & Quantity, 29(1), 1–16. https://doi.org/10.1007/BF01107980
   Google Scholar
• Baumgartner, H., & Steenkamp, J. B. E. M. (2001). Response styles in marketing research: a cross-national investigation. Journal of Marketing Research, 38(2), 143–156. https://doi.org/10.1509/jmkr.38.2.143.18840
   Web of Science ®Google Scholar
• Bentler, P. M. (2008). EQS structural equation modeling software. Multivariate Software.
   Google Scholar
• Bock, R. D. (1972). Estimating item parameters and latent ability when responses are scored in two or more nominal categories. Psychometrika, 37, 29–51. https://doi.org/10.1007/BF02291411
   Web of Science ®Google Scholar
• Bock, R. D., & Aitkin, M. (1981). Marginal maximum likelihood estimation of item parameters: an application of an EM algorithm. Psychometrika, 46(4), 443–459. https://doi.org/10.1007/BF02293801
   Web of Science ®Google Scholar
• Bock, R. D., & Lieberman, M. (1970). Fitting a response model for n dichotomously scored items. Psychometrika, 35(2), 179–197. https://doi.org/10.1007/BF02291262
   Web of Science ®Google Scholar
• Böckenholt, U. (2012). Modeling multiple response processes in judgment and choice. Psychological Methods, 17(4), 665–678. https://doi.org/10.1037/a0028111
   PubMed Web of Science ®Google Scholar
• Böckenholt, U. (2017). Measuring response styles in Likert items. Psychological Methods, 22(1), 69–83. https://doi.org/10.1037/met0000106
   PubMed Web of Science ®Google Scholar
• Bolt, D. M., & Johnson, T. R. (2009). Addressing score bias and differential item functioning due to individual differences in response style. Applied Psychological Measurement, 33(5), 335–352. https://doi.org/10.1177/0146621608329891
   Web of Science ®Google Scholar
• Bolt, D. M., Lu, Y., & Kim, J.-S. (2014). Measurement and control of response styles using anchoring vignettes: A model-based approach. Psychological Methods, 19(4), 528–541. https://doi.org/10.1037/met0000016
   PubMed Web of Science ®Google Scholar
• Bolt, D. M., & Newton, J. R. (2011). Multiscale measurement of extreme response style. Educational and Psychological Measurement, 71(5), 814–833. https://doi.org/10.1177/0013164410388411
   Web of Science ®Google Scholar
• Cai, L. (2017). flexMIRT^® version 3.51: Flexible multilevel item factor analysis and test scoring [Computer software]. Vector Psychometric Group.
   Google Scholar
• Cai, L., & Hansen, M. (2013). Limited-information goodness-of-fit testing of hierarchical item factor models. The British Journal of Mathematical and Statistical Psychology, 66(2), 245–276. https://doi.org/10.1111/j.2044-8317.2012.02050.x
   PubMed Web of Science ®Google Scholar
• Cai, L., & Monroe, S. (2014). A new statistic for evaluating item response theory models for ordinal data (CRESST Report 839). University of California, National Center for Research on Evaluation, Standards, and Student Testing (CRESST).
   Google Scholar
• Chalmers, R. P. (2012). mirt: A multidimensional item response theory package for the R environment. Journal of Statistical Software, 48(6), 1–29. https://doi.org/10.18637/jss.v048.i06
   Web of Science ®Google Scholar
• Dowling, N. M., Bolt, D. M., Deng, S., & Li, C. (2016). Measurement and control of bias in patient reported outcomes using multidimensional item response theory. BMC Medical Research Methodology, 16, 63. https://doi.org/10.1186/s12874-016-0161-z
   PubMed Web of Science ®Google Scholar
• Falk, C. F., & Cai, L. (2016). A flexible full-information approach to the modeling of response styles. Psychological Methods, 21(3), 328–347. https://doi.org/10.1037/met0000059
   PubMed Web of Science ®Google Scholar
• Falk, C. F., & Ju, U. (2020). Estimation of response styles using the multidimensional nominal response model: A tutorial and comparison with sum scores. Frontiers in Quantitative Psychology and Measurement, 11(72), 1–17. https://doi.org/10.3389/fpsyg.2020.00072
   PubMed Web of Science ®Google Scholar
• Falk, C. F., & Monroe, S. (2018). On Lagrange multiplier tests in multidimensional item response theory: Information matrices and model misspecification. Educational and Psychological Measurement, 78(4), 653–678. https://doi.org/10.1177/0013164417714506
   PubMed Web of Science ®Google Scholar
• Freeman, L. (2016). Assessing model-data fit for compensatory and non-compensatory multidimensional item response models using Vuong and Clarke statistics [Unpublished doctoral dissertation]. University of Wisconsin – Milwaukee.
   Google Scholar
• Goldberg, L. R. (1992). The development of markers for the Big-Five factor structure. Psychological Assessment, 4(1), 26–42. https://doi.org/10.1037/1040-3590.4.1.26
   Google Scholar
• Joe, H., & Maydeu-Olivares, A. (2010). A general family of limited information goodness-of-fit statistics for multinomial data. Psychometrika, 75(3), 393–419. https://doi.org/10.1007/s11336-010-9165-5
   Web of Science ®Google Scholar
• Johnson, T. R., & Bolt, D. M. (2010). On the use of factor-analytic multinomial logit item response models to account for individual differences in response style. Journal of Educational and Behavioral Statistics, 35(1), 92–114. https://doi.org/10.3102/1076998609340529
   Web of Science ®Google Scholar
• Jonas, K. G., & Markon, K. E. (2019). Modeling response style using vignettes and person-specific item response theory. Applied Psychological Measurement, 43(1), 3–15. https://doi.org/10.1177/0146621618798663
   PubMed Web of Science ®Google Scholar
• Ju, U., & Falk, C. F. (2019). Modeling response styles in cross-country self-reports: An application of a multilevel multidimensional nominal response model. Journal of Educational Measurement, 56(1), 169–191. https://doi.org/10.1111/jedm.12205
   Web of Science ®Google Scholar
• Khorramdel, L., & von Davier, M. (2014). Measuring response styles across the Big Five: A multiscale extension of an approach using multinomial processing trees. Multivariate Behavioral Research, 49(2), 161–177. https://doi.org/10.1080/00273171.2013.866536
   PubMed Web of Science ®Google Scholar
• Kieruj, N. D., & Moors, G. (2013). Response style behavior: Question format dependent or personal style? Quality & Quantity, 47(1), 193–211. https://doi.org/10.1007/s11135-011-9511-4
   Web of Science ®Google Scholar
• Li, Z., & Cai, L. (2018). Summed score likelihood–based indices for testing latent variable distribution fit in item response theory. Educational and Psychological Measurement, 78(5), 857–886. https://doi.org/10.1177/0013164417717024
   PubMed Web of Science ®Google Scholar
• Liu, C. W., & Wang, W. C. (2019). A general unfolding IRT model for multiple response styles. Applied Psychological Measurement, 43(3), 195–210. https://doi.org/10.1177/0146621618762743
   PubMed Web of Science ®Google Scholar
• Liu, Y., & Thissen, D. (2014). Comparing score tests and other local dependence diagnostics for the graded response model. The British Journal of Mathematical and Statistical Psychology, 67(3), 496–513. https://doi.org/10.1111/bmsp.12030
   PubMed Web of Science ®Google Scholar
• Markus, K. A., & Borsboom, D. (2013). Frontiers of test validity theory: Measurement, causation, and meaning. Routledge. https://doi.org/10.4324/9780203501207
   Google Scholar
• Masters, G. N. (1982). A Rasch model for partial credit scoring. Psychometrika, 47(2), 149–174. https://doi.org/10.1007/BF02296272
   Web of Science ®Google Scholar
• Maurer, T. J., Mitchell, D. R. D., & Barbeite, F. G. (2002). Predictors of attitudes towards a 360-degree feedback system and involvement in post-feedback management development activity. Journal of Occupational and Organizational Psychology, 75(1), 87–107. https://doi.org/10.1348/096317902167667
   Web of Science ®Google Scholar
• Maydeu-Olivares, A. (2013). Goodness-of-fit assessment of item response theory models. Measurement: Interdisciplinary Research & Perspective, 11(3), 71–101. https://doi.org/10.1080/15366367.2013.831680
   Google Scholar
• Maydeu-Olivares, A. (2015). Evaluating fit in IRT models. In S. P. Reise & D. A. Revicki (Eds.), Handbook of item response theory modeling: Applications to typical performance assessment (pp. 111–127). Routledge.
   Google Scholar
• Maydeu-Olivares, A., & Joe, H. (2005). Limited- and full-information estimation and goodness-of-fit testing in 2n contingency tables. Journal of the American Statistical Association, 100(471), 1009–1020. https://doi.org/10.1198/016214504000002069
   Web of Science ®Google Scholar
• Maydeu-Olivares, A., & Joe, H. (2006). Limited information goodness-of-fit testing in multidimensional contingency tables. Psychometrika, 71(4), 713–732. https://doi.org/10.1007/s11336-005-1295-9
   Web of Science ®Google Scholar
• Maydeu-Olivares, A., & Joe, H. (2014). Assessing approximate fit in categorical data analysis. Multivariate Behavioral Research, 49(4), 305–328. https://doi.org/10.1080/00273171.2014.911075
   PubMed Web of Science ®Google Scholar
• Monroe, S., & Cai, L. (2015). Evaluating structural equation models for categorical outcomes: a new test statistic and a practical challenge of interpretation. Multivariate Behavioral Research, 50(6), 569–583. https://doi.org/10.1080/00273171.2015.1032398
   PubMed Web of Science ®Google Scholar
• Muraki, E. (1992). A generalized partial credit model: Application of an EM algorithm. Applied Psychological Measurement, 16(2), 159–176. https://doi.org/10.1177/014662169201600206
   Web of Science ®Google Scholar
• Paulhus, D. L. (1991). Measurement and control of response bias. In J. P. Robinson, P. R. Shaver, & L. S. Wrightman (Eds.), Measurement of personality and social psychological attitudes (pp. 17–59). Academic Press. https://doi.org/10.1016/b978-0-12-590241-0.50006-x
   Google Scholar
• Paulhus, D. L., & Vazire, S. (2007). The self-report method. In R. W. Robins, R. C. Fraley, & R. F. Krueger (Eds.), Handbook of research methods in personality psychology (pp. 224–239). Guilford Press.
   Google Scholar
• Preston, K., Reise, S., Cai, L., & Hays, R. D. (2011). Using the nominal response model to evaluate category discrimination in the PROMIS emotional distress item pools. Educational and Psychological Measurement, 71, 523–550. https://doi.org/10.1177/0013164410382250
   Web of Science ®Google Scholar
• Samejima, F. (1969). Estimation of latent ability using a response pattern of graded scores. Psychometrika, 34(S1), 1–97. https://doi.org/10.1007/BF03372160
   Google Scholar
• Schneider, L., Chalmers, R. P., Debelak, R., & Merkle, E. C. (2019). Model selection of nested and non-nested item response models using Vuong tests. Multivariate Behavioral Research, 54, 1–21. https://doi.org/10.1080/00273171.2019.1664280
   PubMed Web of Science ®Google Scholar
• Schneider, S. (2018). Extracting response style bias from measures of positive and negative affect in aging research. The Journals of Gerontology: Series B, 73(1), 64–74. https://doi.org/10.1093/geronb/gbw103
   Google Scholar
• Stone, A. A., Schneider, S., Junghaenel, D. U., & Broderick, J. E. (2019). Response styles confound the age gradient of four health and well-being outcomes. Social Science Research, 78, 215–225. https://doi.org/10.1016/j.ssresearch.2018.12.004
   PubMed Web of Science ®Google Scholar
• Tafarodi, R. W., & Swann, W. B. (2001). Two-dimensional self-esteem: Theory and measurement. Personality and Individual Differences, 31(5), 653–673. https://doi.org/10.1016/S0191-8869(00)00169-0
   Web of Science ®Google Scholar
• Thissen, D., & Cai, L. (2016). Nominal categories models. In W. J. van der Linden (Ed.), Handbook of item response theory, volume one: Models (pp. 51–73). Chapman & Hall/CRC.
   Google Scholar
• Thissen, D., Cai, L., & Bock, R. D. (2010). The nominal categories item response model. In M. Nering & R. Ostini (Eds.), Handbook of polytomous item response theory models: Developments and applications (pp. 43–75). Taylor & Francis.
   Google Scholar
• Thissen-Roe, A., & Thissen, D. (2013). A two-decision model for responses to Likert-type items. Journal of Educational and Behavioral Statistics, 38(5), 522–547. https://doi.org/10.3102/1076998613481500
   Web of Science ®Google Scholar
• Tutz, G. (2019). What is an ordinal latent trait model? arXiv:1902.06303.
   Google Scholar
• Vachon, D. D., & Lynam, D. R. (2016). Fixing the problem with empathy: Development and validation of the affective and cognitive measure of empathy scale. Assessment, 23(2), 135–149. https://doi.org/10.1177/1073191114567941
   PubMed Web of Science ®Google Scholar
• Wetzel, E., & Carstensen, C. H. (2017). Multidimensional modeling of traits and response styles. European Journal of Psychological Assessment, 33(5), 352–364. https://doi.org/10.1027/1015-5759/a000291
   Web of Science ®Google Scholar